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We establish a heavy-traffic hmit theorem on convergence in dis- 
tribution for the number of customers in a many-server queue when 
the number of servers tends to infinity. No critical loading condition 
is assumed. Generally, the limit process does not have trajectories in 
the Skorohod space. We give conditions for the convergence to hold in 
the topology of compact convergence. Some new results for an infinite 
server are also provided. 

1. Introduction. Heavy-traffic limits for many-server queues is hardly a 
new topic. In particular, there exists a substantial body of literature on the 
Halfin-Whitt regime which is singled out by the requirements of critical 
loading and certain initial conditions. In many instances, by assuming that 
the service time distribution lies within a specific class of probability dis- 
tributions, it has been shown that in the Halfin-Whitt regime the suitably 
centered and normalized processes of the number of customers in the sys- 
tem converge in distribution for Skorohod's Ji-topology to a process with 
continuous trajectories, which may be explicitly identified. This was first 
accomplished in the work of Halfin and Whitt [10] for the case of exponen- 
tial service time distributions and has been continued by many additional 
authors as well for different classes of service time distributions, see, for 
instance, Jelenkovic, Mandelbaum, and Momcilovic [13], Mandelbaum and 
Momcilovic [18], Kaspi and Ramanan [14], Puhalskii and Reiman [21], Whitt 
[25] and the recent survey paper by Pang, Talreja and Whitt [19]. One ex- 
ception to the above list is the work of Reed [22] in which no assumptions 
beyond a first moment are placed on the service time distribution. A related 
avenue of research concerns infinite servers in heavy traffic; see, for example. 
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Krichagina and Puhalskii [15], Pang, Talreja and Whitt [19] and references 
therein. 

The purpose of this paper is to extend the aforementioned results to al- 
low noncritical loading, generally distributed service times, and general ini- 
tial conditions. We consider a sequence of G/GI/n queues. The number of 
servers, n, tends to infinity and the service time distribution is held fixed. It is 
assumed that the centered and normalized arrival processes converge in dis- 
tribution. The main result asserts the weak convergence of finite-dimensional 
distributions of the suitably centered and normalized number-in-the-system 
processes to the finite-dimensional distributions of a unique strong solution 
of a stochastic differential equation of convolution type. In the general case, 
the trajectories of the limit process have discontinuities of the second kind. 

Under a certain condition on the fiuid limit and the service time dis- 
tribution, the limit stochastic process has trajectories in a Skorohod space 
and the convergence in distribution to this process holds for the Ji -topology. 
The results of Halfin and Whitt [10] and Reed [22] follow as particular cases. 
In fact, the convergence in distribution is stated for the stronger topology 
of uniform convergence on compact intervals, which we call the topology 
of compact convergence. This topology plays a prominent role throughout 
the paper so much so that the supporting results are established for this 
topology rather than for the Ji-topology. This emphasis is necessitated by 
the need to rely on certain continuity properties of equations describing the 
evolution of the system's population, which we are able to establish only for 
the topology of compact convergence. 

Furthermore, the topology of compact convergence is almost too strong. 
Since it is nonseparable, the associated Borel a-algebra is strictly larger than 
the Kolmogorov (i.e., cylindrical) c-algebra, which leads to measurability 
problems; see, for example, Billingsley [1], Section 15. As a consequence, 
one needs to extend the notion of convergence in distribution. The relevant 
theory has been developed by Hoffman"j0rgensen and his followers and is 
expounded upon in van der Vaart and Wellner [23]. Its primary motivation 
was to provide tools to tackle convergence in distribution of empirical pro- 
cesses in strong topologies. Empirical processes also play an important part 
in the study of heavy traffic limits for many-server queues, see Louchard [17], 
Krichagina and Puhalskii [15]. This explains why we find methods developed 
in a different context useful for our setting. 

One of the challenges of working with convergence in distribution in non- 
separable spaces has to do with Borel probability measures not being nec- 
essarily tight. Recall that on complete spaces the tightness and separability 
properties are equivalent. Many conclusions of the Hoffman- J 0rgensen the- 
ory rely on the assumption that the limit probability measure is separable. It 
is therefore important to show that the stochastic processes that appear in 
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the limit have separable ranges, so their distributions are separable probabil- 
ity measures. We accomplish this by establishing that certain limit processes 
are Gaussian semimartingales. Since Gaussian semimartingales jump at de- 
terministic times, their ranges are separable sets. As a side remark, there 
are no known examples of nonseparable Borel probability measures and the 
axiom that such measures do not exist can be consistently added to the 
Zermelo-Frankel set of axioms; see Dudley [8], Appendix C, and van der 
Vaart and Wellner [23], Section 1.3, for these and other observations. Our 
results, however, make no use of this fact. 

Another ingredient in the proof of the main theorem is a martingale argu- 
ment which originates from Krichagina and Puhalskii [15]. It is instrumental 
in establishing tightness for the processes of interest. The key that makes an 
application of the methods of [15] possible is the insight of Reed [22] that the 
process of customers entering service in a many-server queue can be treated 
in analogy with the arrival process at an infinite server. There are, however, 
certain improvements on the derivation of the needed martingale properties 
as compared with the cited papers. In particular, our approach clarifies the 
connection with certain two-parameter processes being planar martingales, 
which was implicit in Krichagina and Puhalskii [15]. In addition, the con- 
struction of the limit process and a number of proofs in [15] relied on the 
continuity of the fluid limit. Here it is not necessarily the case, so a more 
subtle argument is called for. As a byproduct, in application to a G/GI/oo 
system our methods enable us to remove the restriction of Krichagina and 
Puhalskii [15] that the fluid limit for the arrival process should be continu- 
ous. 

The paper is organized as follows. In Section 2, the main results are for- 
mulated and discussed and proofs are presented. We first recall basic facts 
about convergence in distribution for nonmeasurable mappings. We then 
state in Theorem 2.1 the fluid limit result of Reed [22], which is given a 
different proof. This proof is useful when dealing with a more general result 
of Theorem 2.3. Theorem 2.2 presents the stochastic approximation result. 
The proof relies heavily on the continuity property of convolution equations, 
on the one hand, and on a result of convergence in distribution of certain 
stochastic processes, on the other hand. The former result is proved in Ap- 
pendix B and the latter result is proved in Section 4. The Gaussian limit for 
a G/GI/oo system is stated in Section 2.3. This subsection also contains ex- 
tended versions of Theorems 2.1 and 2.2. These results are proved by similar 
means, so we omit the actual proofs. Appendix C contains the martingale 
arguments. In Appendix D, we summarize the properties of convergence 
in distribution for nonmeasurable mappings which are, for the most part, 
borrowed from van der Vaart and Wellner [23]. 
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Notation and conventions. The set of real numbers is denoted by M, the 
set of nonnegative reals is denoted by M+, the set of nonnegative ratio- 
nal numbers is denoted by Q+, the set of nonnegative integers is denoted 
by Z+, and the set of natural numbers is denoted by N. For real num- 
bers X and y, x Ay = m.m{x,y), xV y = max(x,y), = x V 0, and [xj 
denotes the integer part. Integrals of the form are understood as 
except when a = 0: we interpret /q" as J^^^j. Similarly, /^a = /[o,oo)x[o,oo)- 
For a function g[x) of a nonnegative real-valued argument, g{x—) denotes 
the left-hand limit at x, g{x+) denotes the right-hand limit at x, and 
I^g{x) = g{x) — g{x—). We always assume that (7(0—) = 0, so /S.g{Q) = g{Q). 
If f{x,y) is a function with domain and xi < X2 and yi < y2, we de- 
fine □/((xi,yi),(x2,y2)) = f{x2,y2) - f{x2,yi) " f{xi,y2) + /(xi,2/i). 1a 
denotes the indicator function of set A. Products of topological spaces are 
assumed to be equipped with product topologies. All random entities are 
assumed to be defined on a common complete probability space P) 
with E denoting the associated expectation. Filtrations are defined as right- 
continuous flows of complete a-algebras. 

2. Main results. 

2.1. Extended convergence in distribution. We recall the concept of con- 
vergence in distribution due to Hoffmann-j0rgensen as presented in van der 
Vaart and Wellner [23]. Let ^ be a real- valued function on 0, which does 
not have to be a random variable, i.e., to be appropriately measurable. The 
outer expectation E*^ of ^ is defined as the infimum of E(^ over all random 
variables C, on (ri, J^, P) such that C,'>^ a.s. and E(^ is well defined. Let S be 
a metric space made into a measurable space by endowing it with the Borel 
(7-algebra B{^). Given a sequence X„ of maps from 17 to S and a measur- 
able map X from (f7,J-") to (S, 5(S)), we say that the Xn converge to X in 
distribution in S if 

hm E7(X„) = E/(X) 

71— >00 

for all bounded continuous real- valued functions / on S. 

In this paper, S will have as its elements right-continuous with left-hand 
limits functions from an interval / on the real line to a complete metric 
space U . We denote this set by D(/, [/). If [/ is, in addition, separable, then 
it is customary to equip D(/, U) with Skorohod's Ji-topology and a complete 
separable metric; see, for example, Jacod and Shiryaev [12], Ethier and Kurtz 
[9]. The resulting Polish space will also be denoted by B(/, U). We hope that 
no confusion will arise out of this ambiguity. 
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For the most part, though, we wiU be concerned with the stronger topol- 
ogy of compact convergence. This topology is compatible with a complete 
metric which can be defined by 

oo 

(i(x,y)=V sup (1 A/9(x(^),y(^)))2-^ 
fc^ite[o,fc]n/ 

where x = (x(t), i G /) and y = (y(t), t G /) are elements of D(I, U) and p is 
the metric on U. We denote this metric space by Oc(/, U) and equip it with 
the Borel cr-algebra. One of the nice properties of the topology of compact 
convergence is that Bc(/, Ui x U2) is homeomorphic to Ui) x Bc(/, U2) 
for arbitrary metric spaces Ui and U2- [Recall that, by contrast, the topology 
of D(M+,M2) is strictly finer than the topology of D(M+,M)2]. 

The space Bc(/, U), though complete, is not separable unless either I ovU 
represent a one-point set. Therefore, the Kolmogorov a-algebra on Bc(/, U) 
is strictly smaller than the Borel cj-algebra, so a stochastic process X with 
trajectories in B(/, U) need not be a random element of Bc(/, U). However, 
if the range of the mapping from to Bc(/, U) defined by X is a separable 
set, then X is a random element of Bc(/, f7). We call such X a separable 
random element. In particular, if X has continuous trajectories a.s., or more 
generally, if its jumps occur at deterministic times a.s., then X is a separable 
random element of Bc(/, U). We say that X is a tight random element if its 
distribution is a tight probability measure on Bc(/, C/). As mentioned, X is 
a tight random element if and only if it is a separable random element. 

Suppose X is a stochastic process which is a random element of Bc(/, U). 
We say that a sequence of stochastic processes X„ with trajectories in 
B(/, U) converges in distribution in Bc(/, U) (or, for the topology of compact 
convergence) to X if the associated maps X„ converge to X in distribution 
in Bc(/, [/). Convergence in distribution in B(/, [/) is defined in a stan- 
dard fashion, provided U is Polish. If the latter is the case, convergence in 
distribution in Iic{I,U) implies convergence in distribution in B(/, ^7) and 
convergence in distribution in B(/, U) to continuous-path processes implies 
convergence in distribution in Bc(/, C/). 

2.2. Limit theorems for the many server queue. We assume as given a 
sequence of many server queues indexed by n, where n denotes the number 
of servers. Service is performed on a first-come-first-serve basis. We denote 
the number of customers present at time 0— by Qq. Out of those, Qq A n 
customers are in service at time 0— and [Qq — n)+ customers are in the 
queue. We denote the remaining service times of the customers in service at 

time 0— by fji,fj2, The service times of the customers in the queue at 

time 0— and the service times of customers exogenously arriving after time 
0— are denoted by 7/2) • • • and come from an i.i.d. sequence of nonnegative 
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random variables with distribution F = {F{x),x € The r]i are not equal 
to zero a.s. Equivalently, we require that 

(2.1) F(0)<1. 

We let E'^{t) denote the number of exogenous arrivals by t. The entities 
Qq, {7/1,7/2,...}, {r/i, 7/2, . . .}, and E'" = i € M+) are assumed to be 

independent. 

Let Q^{t) denote the number of customers either in the queue or in service 
at time t, let A^{t) denote the number of customers that enter service after 
time 0— and by time t, and let Q^{t) denote the number of customers 
remaining in service at time t out of those that were in service at time 0— . 
The introduced stochastic processes are assumed to have trajectories from 
D(M+,M). The following equations appear in Reed [22], cf. also Krichagina 
and Puhalskii [15]: for t E M+ 



(2.2a) Q^it) = (QS - n)+ + Q"(i) + E^{t) - [ [ l^s+.<t} d J2 Um<-}^ 

Jo Jo 

(2.2b) A"(i) = (Q^ - n)+ + E^{t) - (Q"(t) - n)+, 

(2.2c) Q"(t)= 1{^^>,}. 
1=1 

We note that the integral on the right-hand side of (2.2a) represents the 
number of departures by time t of the customers that enter service after 
time 0— as seen from the representation 

^0 Jo 



where 



= inf{tGM+:^"(t) >i}. 



It is shown in Lemma A.l below that, given E"^ , Qq, and the sequences 
{rji} and {r/i}, equations (2.2a)~(2.2c) admit solutions A^, and . The 
processes and are specified uniquely a.s. under the additional re- 
quirement that r]i > a.s. We also provide an example of nonuniqueness 
when the rji can equal zero. Since our results do not assume that the service 
times be positive a.s., we interpret processes and in what follows as 
some solutions to (2.2a) and (2.2b) [the process is specified uniquely by 
(2.2c)]. 

We now introduce the fluid limit equations. Let F = (F(t),t G R_|_) repre- 
sent the distribution function of a nonnegative random variable. According 
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to Lemma B.l, given qo G M+ and a nondecreasing function e = (e(t),t G 
M+) eB(M+,M), there exists a unique function q = (q(t),t gM+) gD(M+,]R) 
which satisfies the equation 



(2.3) 



q(i) = qo - (qo - l^Fit) - qo A lF(t) + e(t) 

- [ e{t-s)dF{s)+ [ (q(t-s)-l)+dF(s) 
Jo Jo 



One can easily see that q is M+-valued. We also define a function a : 
{a{t),t£ M+) G D(M+,M) by the relation 



(2.4) 



a(t) = (qo-l)++e(t)-(q(t)-l) + . 



The next theorem is, in essence, due to Reed [22]. Let = {F'^{t),t G M_|_) 
denote the empirical distribution function of 771, . . . , r/^, that is, 



1 " 



i=l 



Theorem 2.1. Suppose that, for arbitrary T > and e > 0, 

Qo 



lim P 

n— ^00 



n 



qo 



> e 



0, 



lim P sup |F"(i)-F(t)|>e =0 



and 



lim P( sup 

ae[o,T] 



£;'^(t) 



Then, for arbitrary T > and e > 0, 



and 



lim P I sup 

"^00 Vte[o,T] 



lim PI sup 

"^^^^ Vte[o,T] 



n 



A'^it) 



n 



e(t) 



q(i) 



a(t) 



> e 



> e 



> e 



0. 



0. 



Since A'^{t) represents the number of customers that enter service by time 
t out of those that are either queued at time 0— or exogenously arrive after 
time 0—, the process A"' is ]R+-valued and nondecreasing. Hence, under the 
hypotheses of Theorem 2.1, a= {a(t),t GM+) is a nondecreasing M+-valued 
function from D(]R_(_,M). According to the Glivenko-Cantelli theorem, the 
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compact convergence in probability of the to F in the hypotheses holds 
if the f]i are i.i.d. with distribution F. 

An interpretation of equation (2.3) can be as follows. By (2.4), the func- 
tion a = (a(t), t S ]R+) represents "fluid customers entering service after time 
0— ." If we write (2.3) in the form 

(2.5) q(t) = qo + e(t) - (^qo A lF{t) + ^ a(t - s) dF{s)^ , 

then the first two terms on the right have the meaning of "the number of 
fluid customers" seen by time t and the sum in parentheses represents "fluid 
departures" by time t. 

Condition (2.1) cannot be disposed of in general. If we suppose, for in- 
stance, that F(0) = 1, and -F(io) = for some to > 0, then we may obtain 
different fluid limits for the cases where Qq = n and Qq = n— 1 . In the for- 
mer case, Q^{t) = E^(t) + n for all t <tQ as all servers remain occupied until 
to, while in the latter case Q^{t) = n — 1 for t <tQ as the only available server 
will let all exogenously arriving customers out of the system immediately. 

We now state the stochastic approximation result. Define processes = 
(X"(t),t GM+), 5'" = (S"(t),tG]R+), and r" = (r"(t), t G M+) by 



(2.6) 


X"(t) = 


\ n 




(2.7) 


5"(t) = 


MF"{t) - 


-m) 


(2.8) 


y"(t) = 


\ n 


-e{t) 



We note that , 5" and y" are random elements of D(M_|_,]R). However, 
X"^ and might not be random elements of Dc(I^+iI^)- Let us also denote 



^o" =^/^(f -qo). 
We introduce the following condition: 




Theorem 2.2. Suppose that, as n — t- oo, the Xq converge in distri- 
bution in M. to a random variable Xq, the S*" converge in distribution in 
Dc(l^+)I^) to a process S = {S{t),t G M_|_), and the Y"" converge in distri- 
bution in Bc(M+,M) to a process Y = (Y(t),t £ M_|_), where S and Y are 
separable random elements o/Bc(M+,M). Then finite- dimensional distribu- 
tions of the processes X" weakly converge to finite- dimensional distributions 
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of the process X = {X{t),t £ M+) that is a unique strong solution to the 
equation 

X{t) = (Xol{qo>i} + Xo^l{q(, = i}) 

X (1 - F{t)) + (Xol|q„<l} + Xo A 01|q, = i})(l - F{t)) 

+ Vqo A lS{t) + Y{t) - [ Y{t- s) dF{s) + Z{t) 

Jo 

+ / (X(t-s)l|q(f_,)>i}+X(t-s)+l|q(j_,) = i})dF(s), 

Jo 

where Z = {Z{t),t € M+) is a zero-mean Gaussian semimartingale with tra- 
jectories from D(M4.,]R) specified by the covariance 

/•sAt 

BZ{s)Z{t)= / F{s At-u){l- F{s\/t-u))da{u), 
Jo 

the entities Xq, S, Z and Y being independent. The trajectories of X are 
Borel measurable and locally bounded a.s. If, in addition, condition (2.9) 
holds, then X is a separable random element of^3c{^+,'^) and the X"" con- 
verge in distribution in Oc{M.^,M) to X. 

We now comment on this theorem. As with Theorem 2.1, the convergence 
of the 5"" in the hypotheses holds when the fji are i.i.d. with distribution F. 
In such a case, S{t) = W^{F{t)), where = {W^{t),t G [0, 1]) is a Brownian 
bridge. 

Since the process Z is a Gaussian semimartingale, its jumps occur at de- 
terministic times which are the jump times of its variance, see Jacod and 
Shiryaev [12], Chapter II, Section 4d, and Liptser and Shiryayev [16], Chap- 
ter 4, Section 9, so this process is a separable random element of Dc(IK+)l^)- 
If either F or a is a continuous function, then Z is a continuous path pro- 
cess. In particular, if Y , F and F are continuous (with F{0) = 0), then X 
is continuous (see Lemma B.l). 

Similarly to Krichagina and Puhalskii [15], Z admits a representation as 
a stochastic integral, which follows from the proof of Lemma 4.4 below. 
Specifically, we may assume that a.s. 

(2.10) z{t)= [ i{,+,<t|(ir(s,x), 

JrI 

where (r(s, x),s £ M+, x E M+) is a zero-mean Gaussian process with covari- 
ance 



Er(s, x)r{t, y) = (a(s) A a(t)) (F(x) A F{y) - F{x)F{y)). 
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The integral on the right of (2.10) is understood as a mean-square hmit of 

/ i^{s,x)dr{s,x) = Y,in4.t-sU)-r{s[_^,t-sl,)) + mt), 

where = s^^ < s[ < 4 < ■ ■ ■ < s\ = t, Ii,t{s,x) = ELi l{.e(4_„s']} 
l{o<x<t-s5_i} + l{s=o}l{o<x<f}' and maxi{s[ - s[_^) ^Oasl^oo. 

As mentioned, the trajectories of X may have discontinuities of the second 
kind. To illustrate, suppose that F(t) = l{j>i}, q is continuous, q(t) < 1 for 
t < 1, q(2) = 1 and, as 1 1 2, q(t) infinitely many times changes from being 
less than 1 to being greater than 1 and back. Suppose also that e, F, and 
Y are continuous. Then the function a is continuous, so Z is continuous. 
Consequently, all terms in the equation for X{t) except for the last one 
have limits as t\3. The last term equals X{t — 1) when q(t — 1) > 1, equals 
X{t — when q{t — 1) = 1, and equals when q(t — 1) < 1. Therefore, 
there are three subsequential limits as t'f 3: ^(2), X(2)+, and 0, which 
shows that X{3—) may be undefined. For example, we may take 

^ ' -(t-l)2+7rt + l), 0<t<l, 



e(t) = <^ 



1 + 7r 
1 

1 +7r 



(t _ 2)^ + 7r(t - 1) 
+ l + (t-2)2sin^^ ) +1, l<t<2 



and qo = 0. Then q(f) = &{t) < 1 for t G [0, 1], so 

q(t) = e(t) - e(t - 1) + (q(t - 1) - 1)+ = 1 + -^(i - 2f sin ; 



l + vr' ' 2-t 
for te [1,2). 

As follows by Lemma B.l, if any interval [0,T] can be partitioned into 
finitely many intervals such that on each of these intervals the function q 
either stays below 1, or stays at 1, or stays above 1, then the trajectories 
of X admit left and right-hand limits. To show that even then X does not 
necessarily have trajectories from D(]R+,M), consider the example where 
Qq = 0, -E" is a Poisson process of rate n, and F{t) = l|j>2}. Then e{t) = 
t, y is a standard Wiener process, and Z(t) = 0. For the fiuid limit, we 
have q{t) = t for t < 2, q(t) = 2 for 2 < t < 3, q{t) = t - 1 for 3 < t < 4, 
q(t) = 3 for 4 < t < 5, q(t) = t-2 for 5 < t < 6, etc. The process X is 
of the form: X{t) = Y{t) for t < 2, X{t) = Y{t) - Y{t - 2) for 2 < t < 3, 
X{3) = y(3) - y(l) A 0, X{t) = Y{t) for 3 < t < 4, X{t) = Y{t) - Y{t - 4) 
for 4 < t < 5, X{5) = y(5) - y(l) A 0, X{t) = Y{t) for 5 < t < 6, etc. To 
sum up, there are two alternating patterns: X{t) = Y{t) which occurs when 
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< t < 2 or 2A; + 1< f < 2fc + 2 for A; G N and X{t) = Y{t) - Y{t - 2k) which 
occurs when 2k <t <2k + \ for /c S N. We can also see that the trajectory 
X(t),t € M+, is right-continuous when 1^(1) > and is left-continuous when 
^(1) ^ 0. To see that convergence in Skorohod's Ji-topology to the right- 
continuous version of X does not hold for this example, note that [cf. (3.21) 
in the proof of Theorem 2.2] 

x"(t) = y"(t)-y«(t-2)i{,>2} 

+ - 2) + V^(q(t - 2) - 1))+ - V^{q{t - 2) - l) + )l{t>2}. 

It follows that suptg[o^4] |AX"(t)| < 3suptg[o,4] |Ay"(t)| = 3/^/n. On the other 
hand, X{3+) — X{3—) = Y{1), so the jumps of X" "do not match" the jumps 
of X, which rules out convergence in distribution of the X" to the right- 
continuous version of X for the Ji-topology. One can talk of convergence in 
the Mi-topology, see Whitt [24] for the definition and basic properties. 

A sketch of the proof of the latter mode of convergence is as follows. 
It is obvious that the X" converge in distribution to Y on [0, 2] for the 
topology of compact convergence. It is also easy to see that on [2, 3 — e] and 
on [3 + e,4], for arbitrary e G (0, 1), there is convergence for the topology of 
compact convergence to Y{t) — Y{t — 2) and to Y{t), respectively. Suppose 
t £ [3 — e, 3 + e] . Then on assuming that the X" converge to Y in the topology 
of compact convergence on [0, 2] a.s. and noting that 

sup \{{X^{t - 2) + V^(q(t - 2) - 1))+ - V^(q(t - 2) - 1)+) 

t&[3-£,3+e] 

- ((y(l) + V^(q(t - 2) - 1))+ - V^(q(t - 2) - 1)+)| 
< sup sup \Y{t)-Y{l)\, 

te[0,2] te[l~e,l+£] 

we have by continuity of Y that the latter left-hand side can be made arbi- 
trarily small if n is large enough and e is small enough. Now it is an easy 
matter to verify that the (Y{1) + ^/n{q{t - 2) - 1))+ - ^/n{q{t - 2) - 1)+ con- 
verge to y(l)l{fg[3^3+£]} as n — )• oo in the Mi -topology on [3 — e,3 + e], cf., 
Whitt [24], page 82. It follows that the converge to the right-continuous 
version of X for the Mi -topology on [0,4]. Because of the periodic pat- 
tern observed above, we derive Mi-convergence on M+. We conjecture that 
convergence in the Mi -topology holds more generally. 

The Halfin- Whitt regime is obtained when qo = 1, e{t) = At for some A > 
0, and F{t) = A /q (1 - F{s)) ds. By (2.3), q(t) = 1 for t G R+. The equation 
for X in the statement of Theorem 2.2 takes the form 

Xit) = X+{1 - F{t)) + XoA 0(1 - F{t)) + Sit) + Y{t) 

t f-t 
Y{t-s)dF{s) + Z{t)+ / X{t-s)+dF{s). 

Jo 
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Usually, instead of there being a limit for the processes as defined in (2.8) 
one assumes that Jq sdF{s) < oo and that there exist p"' € (0,1) with 
\/n(l — p") converging to a finite limit as n — )■ oo such that the {^/n{E'^ [t) / n — 
p^tj s dF{s)),t E M_|_) converge in distribution. These hypotheses imply 
convergence of the l"" with e{t) = t/{f^ sdF{s)). 

We discuss condition (2.9). It obviously holds for the Halfin-Whitt regime. 
By Lemma B.3, it also holds when is a continuous function with -F(O) = 0. 
If the function F has atoms, then (2.9) holds if and only if q does not attain 
level 1 "in a continuous fashion," loosely speaking. More precisely, if and 
only if lime_5.ot£ = oo, where = inf{t : |q(t) — 1| G (0,e)}. To see that, note 
that if to represents a jump time of F and < oo, then the left-hand side 
of (2.9) is greater than or equal to AF(to) for all T > to + ^e- 

For instance, if F contains atoms, e is continuous, qo < 1, and there exists 
some t>0 such that q(t) > 1, then (2.9) cannot hold. This follows by the 
fact that if e is continuous, then by (2.5) q cannot have upward jumps. 
Therefore, upcrossings of level 1 occur in a continuous fashion. On the other 
hand, q may have downward jumps. If it starts above 1, then it may get 
below this level without spending time in small neighborhoods of 1, so it 
is possible for (2.9) to hold. Consider the following example. Suppose that 
qo = 2 and e(t) = for t > so that (2.3) becomes 

q(t) = 2 - F{t) - F{t) + [\ci{t -s)- 1)+ dFis). 

Jo 

Furthermore, suppose that F{t) = F{t) = l{t>i}- We then have that q(t) = 2 
for < t < 1, q(t) = 1 for 1 < t < 2, and q(t) = for t > 2. 

2.3. Extensions. In this subsection, we state a number of results which 
admit similar proofs. 

We begin by extending Theorems 2.1 and 2.2 to the case where the cus- 
tomers in the queue at time 0— and the customers exogenously arriving after 
time 0— may have differently distributed service times and where there can 
be available servers at time 0— even when there are customers awaiting 
service. Thus, r]i,r]2,--- represent service times of the exogenously arriving 
customers. Condition (2.1) is still assumed. We denote the number of cus- 
tomers in the queue at time 0— by Qq. Their service times are denoted 
fji,fi2, ■ ■ ■ and come from an i.i.d. sequence of nonnegative random variables 
with distribution F. As with the r/j, it is assumed that the fji are not equal 
to zero a.s., that is, F{0) < 1. We retain the rest of the previous notation 
and assumptions. The entities Qq, Qq, {fji,fj2, ■ ■ ■}, {i?i,??2, • • •}, • ■ •}, 

and E^ = {E'^{t),t € M+) are assumed to be independent. 

Let A"(t) denote the number of customers that enter service by time t 
out of those that have arrived after 0—, let A"(t) denote the number of 
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customers that enter service by time t out of those that were in the queue at 
time 0—, and let Q^{t) denote the number of customers out of those present 
at time 0— that have not left by time t. The introduced quantities satisfy 
the following equations for t G M+ : 



Q^{t) = Q^{t) + E^{t) 



'^{s+x<t}d ^ l{»?i<x}> 
i=l 



JO 



A^{t) = E^{t) + - n)+ - (Q"(t) - ny 

Q"(t)=Q^ + Q-(t) 



/O JQ 

i-(t)=Q^-(Q"(t)-n)+, 



i=l 



i=l 

The fluid limit equations are of the form 

q(t) = e(t) - [ e{t- s) dF{s) + q(t) - [ (q(t - s) - 1)+ 
Jo Jo 

+ f\q{t-s)-l)+dF{s), 
Jo 

q(t) = qo(l - + qo(l - F{t)) + [\ci{t - s) - 1)+ dF{s). 

Jo 

Existence and uniqueness of solutions to these equations are addressed in 
Lemma A.l and by Lemma B.l. 

We also define functions a = (a(t),t G M+) G ]D)(M+,M) and a = (a(t),t G 
M+) G B(M+,M) by the equalities 

a(i)=e(t) + (q(t)-l)+-(q(0-l)+, 

a(t)=qo-(q(t)-l) + . 



Theorem 2.3. Suppose that, for arbitrary T > and e > 0, 

>e]=0, 



lim P 

n— >oo 



qo 

n 



hm P 

n— >-oo 



Qo 



n 



qo 



> e 



0, 



lim P sup |F"(t)-F(t)|>e =0 
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and 



lim P( sup 

ViG[0,T] 



n 



-e{t) >e^ =0. 



and 



lim P( 

n— >-oo \ 


sup 

Kt£[Q,T] 


n 


-q(t) 


lim P( 


sup 

VtG[0,T] 


n 


-q(t) 


lim PI 

n— ^-oo ' 


sup 

Vie[0,T] 


n 


-a(t) 


lim P 

n— >cxD 


sup 

Vte[o,T] 


n 


-a(t) 



> = 0, 

> = 0, 
=0 

>e ) = 0. 



For a stochastic approximation result, we assume that the processes = 
G M+), 5" = G R+), and = (y"(t),t G M+) are defined 

by (2.6)-(2.8), respectively. We also denote 

= V^(^Iq^ - qo) , = V^I^^Qo - qo) ■ 



Theorem 2.4. Assume that the Xq and Xq converge in distribution 
in M to random variables Xq and Xq, respectively, as n —t- oo. // the 
converge in distribution in Dc(M+,R) to a process S = {S{t),t G M4.) and the 
Y"' converge in distribution in Bc(]R-|_,]R) to a process Y = (Y{t),t G ]R_|_) 
such that S and Y are separable random elements of DcO^+,^) , then the 
processes X" converge in the sense of finite- dimensional distributions to the 
process X = {X{t),t G M+) that is a unique strong solution to the set of 
equations 

X{t) = Y{t)- [ Y{t-s)dF{s) + Z{t)+X{t) 
Jo 

t 

{Xit - S)l{q(t_,)>l} + X{t - S)+I{q(t-S) = l}) dF{s) 

+ I (^(t-s)l{q(t-s)>l}+^(i-s) + l{q(t_,) = l})dF(s) 
JO 
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and 

X{t) = Xo(l - F{t)) + Xo(l - F{t)) + ^/^oS{t) + Z{t) 

+ I {X{t-s)l{(^^t-s)>i}+X{t-s)+l{(^^t-s)=i})dF{s), 
Jo 

where Z = {Z{t),t G M+) and Z = {Z{t),t G M+) are zero-mean Gaussian 
semimartingales with trajectories in B(M_|_,]R) and with respective covari- 
ances 

f-sAt 

EZ{s)Z{t)= / F{s At-u){l- F{s\/t-u))da{u) 
Jo 

and 

psAt 

BZ{s)Z{t)= / F{s At-u){l- F{s\/t-u))da{u), 
Jo 

the entities Xq, Xq, Z, Z , S and Y being independent. The trajectories of 
X are Borel measurable and locally bounded a.s. 
If, in addition, for all T > 0, 

lim sup / (l{0<|q(t_s)-l|<£} + l{0<|q(i-5)-l|<£})t^^(s)=0 
^^^tGlO.T] Jo 

and 

lim sup / l{o<|q(t_s)-l|<e}C^^(s) =0, 

=-^Ote[o,T] Jo 

then X and X are separable random elements o/Dc(M+,M) and the X" 
converge in distribution in Bc(M-|_,]R) to X . 

We conclude this subsection with the Gaussian approximation result for 
an infinite server. Consider a sequence of G/GI/oo systems indexed by n. 
Adapting the earlier notation, we denote by Q (t) the number of customers 
present at time t and we denote by E'^{t) the number of exogenous arrivals 
by t. We also reuse the introduced earlier sequences {fji,i G N} and {T]i,i G 
N}. As above, they represent the remaining service times of customers in 
service at time 0—, whose number is denoted by Qq, and the service times of 
exogenously arriving customers, respectively. The rji are assumed to be i.i.d. 
with distribution F, however, by contrast with condition (2.1) we allow these 
random variables to equal zero a.s. The entities i?" = G Qq, 

{fji,i £ M+} and {rii,i £ M+} are assumed to be independent. The evolution 
of the process Q = {Q {t),t £ M+) is governed by the equation 



i=l J^ -^0 i=l 



{Vi<x}- 
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It specifies the process Q uniquely. In analogy with the earlier notation, 
given qo G M-|- and a nondecreasing function e = {e{t),t G M+) G D(M-|_,M), 
we define q(t) = qo(l - F{t)) + e{t) - e{t-s) dF{s),jr{t) = ^Jn{Q^{t)/n - 
q(i)), XI} = ^{Qlln - qo), and we define 5"(t) and ^{t) by (2.7) and 
(2.8), respectively. 

Theorem 2.5. Suppose that, as n —)• oo, the Xq converge in distribution 
in M. to a random variable Xq, the processes S"' = {S"'{t),t G M+) converge 
in distribution in Of^(M_|_,]R) to a process S — (*S*(t),i G IR._j_), and the pro- 
cesses y" = {Y^{t),t G M+) converge in distribution in I])c(M.+ ,M.) to a pro- 
cess Y = {Y{t),t G K+), where S and Y are separable random elements of 
Bc(M+, M) . Then the processes X ={X {t),t£R+) converge in distribution 
in I])c{R+,R) to the process X= (X{t),te M+) defined by 

X{t) = (1 - F{t))Xo + Vq^5(t) + Y{t) - f Y{t - s) dF{s) + Z{t), 

Jo 

where Z= (Z'(i),i GM+) is a zero-mean Gaussian semimartingale with tra- 
jectories in D(M_|_,M) and with covariance 

/•sAt 

EZ(s)Z(t)= / F{sAt-u){l-F{s\/t-u))de{u), 
Jo 

the entities Xq, S, Z and Y being independent. 



For the case of a continuous Y, the latter limit theorem generalizes the 
earlier results by Borovkov [2] (which result can also be found in Borovkov 
[3], Chapter 2, Section 2) and Krichagina and Puhalskii [15]. We recall that 
Borovkov [2] imposed a Holder continuity condition on the function (J^ (1 — 
F{t — s)) de{s),t G M+) and Krichagina and Puhalskii [15] required e to be 
continuous. 

3. Proofs of the main results. This section contains proofs of Theorems 
2.1 and 2.2. 



3.1. Preliminaries. We start by developing semimartingale representa- 
tions for certain processes. On introducing 

A"(t) 

(3.1) y"(t,x) = -= ^(l|,^<,|-F(x)), 



n 

i=l 



we have by (2.2a) 



-Q-(t)= -Q^'-l +-Q^{t) 
n \n In 



(3.2) 

where 
(3.3) 

Let 
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+ l^«(t) _ i r A"(t _ s) dF{s) + ^Z"(t), 

Z^{t) = - [ dy"(s,x). 



rx ynu \ 

(3.5) V'^{t,x) = - I 7 ; dF(n) + L"(t,x). 



(3.4) 

Then by (3.1) 

T/"Cf ^•\ = - [ 

\-F{u-) 
Hence, by (3.3), 

(3.6) Z'^(t) = G"(t)-M"(t), 
where 

(3.7) G^{t)= f ^y~J;'''~^ dF{x) 



F{u- 



1-F{x- 



and 



(3.8) M^{t)= [ l|,+,<i}(iL'^(s,x). 
We note that by (3.1), (3.4) and (3.8) 

(3.9) M"(t) = r"(t,0)+ / l{,>o}l{.+x<t}d^"(5,^)- 
We also define, for A; G N and t G R+, 

(3.10) Mfc"(t)=/ l|,+,<f}dL^(s,x), 

where 

(3.11) L^(5,x) = ^ ^ l{o<,,.<x}-/ 



1{«>0} 



dF(n) 



1 -F('u- 



and 

(A4")(t)= / l{,+,<i|d(L^)(s,x) 
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where 

For t G M_|_ , let denote the complete cj-algebra generated by the random 
variables l{T-n<s}l{^.<2,}, where x + s <t and z G N, and by the A^[s) (or, 
equivalently, by the l{T-n<;^| for i G N), where s <t. We introduce "the right- 
continuous modification" by = ne>o^t+e- Then G" = {G"^ ,t G IR+) is a 
filtration. 

The next lemma originates in Krichagina and Puhalskii [15], Lemma 3.5, 
see also Reed [22], Lemma 1, where larger filtrations are used. Our conditions 
are closer to minimal ones. The proof is also different from those in the cited 
papers and is more direct. 

Lemma 3.1. For each A: G N, the process MJ! = {M]!{t),t£ M+) is a G"- 
square integrable martingale starting at with predictable quadratic variation 
process {MJ}) = {{MJ!){t),t £R+). 

Proof. According to Lemma C.3 it suffices to prove that, given i G N, 
s G M_|_ and x G M_|_, the random variable rji is independent of the random 
variables r]j for j 7^ i, of the r" for j <i, and of the r" A{s + x) for j > i, when 
conditioned on the event {r" >s,rii> x} and that r]i is independent of the 
r" for j < i. By (2.2a)-(2.2c), the r" for j <i are measurable with respect 

to the o"-algebra generated by Qq, Qq, fjj,j G N, r]j,j < i, and E^{t),t G M+. 
By the independence assumptions in the hypotheses, this cr-algebra and r]i 
are independent, hence, r" for j <i and rji are independent. 

Let ^4"'* = {A'^'^{t),t G M+) denote the process of exogenous arrivals enter- 
ing service that would occur if the ith exogenously arriving customer had an 
infinite service time and let r"'' = inf{t : >j}. Then by (2.2a)-(2.2c) 

the r"'* for j G N are measurable with respect to the c-algebra generated by 

Qq, Qq, fjj,j G N, r]j,j < i, and E'^{t),t G ]R_|_. Hence, they are independent 
of rji. Therefore, r]i, on the one hand, and i]j for j 7^ i, r" for j < i, and 

r"'* for j > i, on the other hand, are independent. In addition, as it follows 
by (2.2a)-(2.2c), on the event {r" > s,r]i> x} the ith exogenously arriving 
customer does not depart until after time s + x, which means that she has 
the same effect on the epochs before time s + x when exogenously arriving 
customers enter service as if she never completed service. To put it precisely, 
r"'* A{s + x) = r" A (s -|- x) for j G N on the event {r" > s,r]i> x}. 

By the established independence property, we have for natural numbers 
ri,r2, . . . ,r/ none of which equals i and i < pi < p2 < ■ • ■ < Pm, and for 
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bounded Borel functions fi, . . . , fi, gi, . . . , gi, hi, . . . , hm, and /, on assuming 
that conditional probabilities given events of probability zero equal zero and 
adopting the convention that 0/0 = 0, 

/ I i m \ 



\j=l j=l j=l 



\j=l 3=1 

m \ 
X n^i(^p" ^ (s + a^))/(??i)l{rr>.,»?,>x} /P(Tr >S,T]i> x) 

j=l J 
\j=l j=l 

m \ 

X n ^i^^pf ^ + 2;))/(r?,)l{r;^>s,,,,>x} / PCrf > s, r?, > x) 
j=i J 



= E n n*(^") n ^ + ^))i{rr>.} 

Vi=i j=i j=i / 

X E(/(7?,)l{,.>x}) /P(rr > 5)P(r?« > x) 

_ MVrM3=i 9jir^) UT=i hji^pf A + x))l|.n>,^l{^^^,^) 

P(7"f >s,r]i> x) 

^ifi'ni)'^{vi>x}^{Ti^>s}) 
P(Tf >s,r]i> x) 

P(Tf >s,r]i> x) 
E(/(??i)lfa>x}l{r;^>4) 

(I i m \ 

j=i j=i j=i ) 

xE(/(r?i)|rr>s,r/i>x). 
An application of Lemma C.3 completes the proof. □ 
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Remark 3.1. We stop short of claiming that M" is a G"-locally square 
integrable martingale because there might not be a sequence of stopping 
times such that the "stopped" processes A" are bounded. However, if, in 
addition, the jumps of (including the "jump" at zero) are uniformly 
bounded, then M" is a G"-locally square integrable martingale. 

3.2. Proof of Theorem 2.1. 

Lemma 3.2. Under the hypotheses of Theorem 2.1, for T > 0, 
lim limsupPf sup |Z"(t)| > ft) = 0. 

Proof. In view of (3.6), it suffices to prove that 



(3.12) lim lim sup P sup |G"(t)|>6 =0 
and 

(3.13) lim lim sup P( sup |M"(t)| > = 0. 
Let us firstly note that, for t > and h large enough, 

(3.14) lim P( -^"(t) >6 ) =0, 

n— >-oo yn J 

which follows by the bound A"(t) < (Q[J - ?i)+ + £;"(*) [see (2.2b)] and the 
convergence in probability of Q^/n to qo and of E^{t)/n to e(t) in the 
hypotheses of Theorem 2.1. 

The proof of (3.12) is analogous to the proof of (3.23) in Krichagina and 
Puhalskii [15]. Let 

\nt\ 

(3.15) F"(t,x) = -= ^(1{,.<..} - F{x)). 

We have, for c > 0, on taking into account (3.1), (3.7) and (3.15), 

pf sup |G"(i)| <pf-A"(r) >cr^ 

^tG[0,T] J \n ) 

By (3.15), for fixed x, y"(4,x) is a locally square-integrable martingale in t 
relative to the natural filtration with predictable quadratic variation process 
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{[nt\/n)F{x){l — F{x)). Theorem 1.9.5 in Liptser and Shiryayev [16] yields 
the bound Esupjgp^cT] < 3v^cr(l - F(x-)). Hence, 

p Esup,gto,,r]|y"(t,F(x-))| ,..r^ 

so (3.12) follows by an application of Markov's inequality and (3.14). 

Next, on noting that M"(i) = F"(^"(t)/n,0) + M^(t) when ^"(t) < fc, 
we have by (3.9), Lemma 3.1, Kolmogorov's inequality, and the Lenglart- 
Rebolledo inequality; see, for example, Liptser and Shiryayev [16], Theorem 
1.9.3, for 6>0 and OO, 

P( sup |M"(t)| >6) <P(A"(T) > [n6Tj) + pf sup |t>"(t,0)|>^ 

+ p( sup \Ml^,^p)\>\ 

< P(A"(r) > Ln6Tj) + 1^^^ + P((Afp„,^j)(T) > c) 

< P(^'^(T) > [nfeTj ) + ^ 



62 

[nfcTJ 



+ P 



1 W /-"^ l-F('u) , \ 

'^"^'^'> (l-F(n-))2 '^^("^>^j- 



By Markov's inequality, 

P(;;Ey„ ><=]<- 

so, on picking c = ^^/^j^i/s^ 

P( sup |M"(t)| > 6) < P(A"(T) > Ln6Tj) + % + sJ^. 
^t6[0,T] ^ \ b 

The convergence in (3.13) now follows by (3.14). □ 

Proof of Theorem 2.1. Denote e"(t) = ^"(t)/n, q[J = Q^J/n, q"(t) 
Q"(i)/n, and q"(t) = Q''{t)/n so that by (2.2b) and (3.2), 

ft 



(3.16) 



q"(t) = (q^-l)++q"(t)+e"(i)- / e^{t-s)dF{s) 

Jo 

+ [\cfit-s)-l)+dF{s) + ^Z^{t). 
Jo Vn 
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By Lemma 3.2, the sup^gjg |Z"(t)|/-^/n converge to zero in probability for 
every T > as n — t- oo. By hypotheses, the (qq — 1)"*^ and A 1 converge in 
probability to (qo — l)"*" and qo A 1, respectively. By (2.2c) and the hypothe- 
ses, the q"(t) converge in probability uniformly over compact intervals of t 
to qo A 1(1 — F{t)). Also, the compact convergence in probability of the e" 
to e implies that 



sup 

te[o,T] 



e"(t) - e"(t - s) dF{s) - (e{t) - e{t - s) dF{s)j 



converges to zero in probability. Hence, on applying part 1 of Lemma B.2 
to (3.17), we conclude by the fact that a sequence of random variables con- 
verges in probability if and only if its every subsequence contains a further 
subsequence that converges a.s. that the sequence supjg[o,T] |q"(*) ~ q(OI 
converges in probability to zero as required. 
The convergence 

■^"W a(t) 



lim P( sup 

tG[0,T] 



n 



> e 







follows by (2.2b) and the part of the theorem already proven. □ 

3.3. Proof of Theorem 2.2. The key to the proof of Theorem 2.2 is the 
following result whose proof is deferred until the next section. Denote 

(3.17) H{t) = Y{t)- [ Y{t-s)dF{s), 

Jo 

(3.18) H"{t) = Y''{t)- ['Y"{t-s)dF{s), 

Jo 

(3.19) X"(t) = V^f-Q'^it) - qo A 1(1 - Fit))] , 



(3.20) X{t) = (Xol|q„<i} +XoA 01{q„=i|)(l - Fit)) + VqoATS(i). 

Let H = {H{t),t G M+), H"" = {H''{t),t G M+), X = {X{t),t G M+), X" 
(X"(t),t G M+), and = (Z"(t),t G R+). We also denote 

^? = ^/^(^(Qo-")+-(qo-l)" 

-'^O = ^Ol{qo>l} +Xo^l{qo=l}- 



Theorem 3.1. Under the hypotheses of Theorem 2.2, the processes X, 
H and Z are separable random elements of Mc(M.^,M). As n — )• oo, the 
(X^,X",i7",Z") converge in distribution m M x Dc(lR+, IR)^ to {Xo,X,H,Z). 
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Given Theorem 3.1 and Lemmas B.l and B.3, the proof of Theorem 2.2 
is now routine. On recahing that X"'[t) = y/n{Q'^{t)/n — q(t)), we have by 
(2.2b), (2.3), (2.4), (3.2), (3.18) and (3.19), that 

X'^(t) = 1^(1 - F{t)) + X"(t) + if"(t) + Z"(t) 

(3.21) + A(X"(t -s) + V^(q(t -s)- 1)) + 

^0 

- V^(q(t-s)-l) + )dF(s). 

On writing (3.21) as X" = ^"(XJ, X", iJ", Z"), we have by applying part 
2 of Lemma B.2 with P{y,t) = {y + v^(q(t) - 1))+ - V^(q(t) - 1)+ and 
/(y,t) = yl{q(t)>i} + y+l{q(f)=i} that if x« ^ x in M x De(M+,I^)^ then 
^'"(x"')(i) — y(t) for ah t, where y = (y(t),t G M_|_) is determined by the 
foUowing equations assuming that x = (xi, X2, X3, X4) with xi G M and x, = 
(xi(t),tG]R+) for i = 2,3,4: 

y{t) = xi(l - F{t)) + X2(t) + X3(t) + X4(0 

+ / (y(i-'S)l{q{t_s)>l}+y(t-s) + l{q(t-s) = l})'i-?^(s)- 
JO 

These equations specify y uniquely by Lemma B.l. The hypotheses and 
Theorem 3.1 imply that, as n— t-oo, the (Xq , X", ff", Z") converge in dis- 
tribution in M X Dc(IR+,M)3 to {Xq,X,H,Z), which is a separable random 
element. Therefore, by the continuous mapping principle (see Theorem D.2), 
the X" converge in the sense of weak convergence of finite-dimensional distri- 
butions to X = ^'(Xo) Z), where ^'(xi, X2, X3, X4) = y. The trajectories 
of X are a.s. Borel measurable and locally bounded by Lemma B.l. 

If, in addition, condition (2.9) holds, then, by Lemmas B.2 and B.3, 
X has trajectories in D(]R+,]R) and the convergence \I'"'(x") — )■ y holds in 
Dc(IK+)]R)- An application of the continuous mapping principle implies con- 
vergence in distribution in Dc(M+,M) of the X" to X. By Lemma B.2, ^I* 
is a continuous mapping from M x Dc(IK-i-,lK)'^ to Dc(lK+,lK), so X is a tight 
random element. Hence, it is a separable random element. 

4. Proof of Theorem 3.1. In Section 4.1, we derive certain properties of 
the processes that appear in the limit, emphasizing the property of being 
a separable random element. In Section 4.2, results on joint convergence in 
distribution are established. These developments culminate in the proof of 
Theorem 3.1 in Section 4.3. The hypotheses of Theorem 2.2 are assumed. 

4.1. Properties of processes associated with the Kief er process. Let K = 
{{K{t,x),x £ [0,1]), t G M+) be a Kiefer process such that K, Y, Xq and X 
are independent. Recall that this means that K is a, zero-mean Gaussian 
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process with EK{t,x)K{s,y) = {t A s){x Ay — xy). In particular, K{t,x) is 
a Brownian motion in t for fixed x. We choose a modification of K which is 
continuous in both variables a.s. Introduce for t G M+ and x S M+, 



(4.1) 
(4.2) 

and define 
(4.3) 

(4.4) 

(4.5) 



V{t,x) = K{si{t),F{x)), 
U{t,x) = K{t,F{x)), 



L{t,x) = V{t,x) + 
L'{t,x) = U{t,x) + 
G{t)- 



Vit,u-) 
l-F{u-) 

U{t,u-) 
1-F{u-) 

* V{t-u,u-) 



dF{u) 
dF{u) 







■dF{u). 







1 - F{u- 

The integrals on the right of (4.3)~(4.5) converge absolutely a.s. To see this, 
note that V{t,x) is a locally square integrable martingale in t for fixed x 
relative to the natural filtration with predictable quadratic variation process 
ai{t)F{x){\ — F(x)). Therefore, by Theorem 1.9.5 in Liptser and Shiryayev 
[16], for T > 0, Esupig[o,T] < ^\/a{T){l - F{x-)). We thus obtain 

Esuptg[o,T] \V{t,u-)\ 



(4.6) 

so that 
(4.7) 



1-F{u-) 



■ dF{u) < 



3Va(t) 
- Fi^-) 



dF{u) 



SUPt6[0,T] \V{t^U-)\ 



dF{u) < oo 



a.s. for T > 0. 



1-F{u-) 

A similar argument shows that for arbitrary T > and 6 > 

V{t,u 



(4.8) limP sup sup 



te[o,T] x& 



and 



(4.9) limPI sup sup 

VtG[0,T]a;eM+ 

Denote 

(4.10) F'{x) 



1 _ ^ W«-)>i-^} ^^(^) 

U{t,u-) ^ 
Y3-^^^l{F(«-)>i-e} dl' {u) 

^ ^ ■dF(n). 



>6 



>6 



0. 



1-F{u-) 

Let U = {{U{t,x),x G M+),t G R+), V = {{V{t,x),x G M+),t G M+), L = 
{{L{t,x),x G ffi+),i G ffi+), L' = {{L'{t,x),x G M+),t G M+), and G = (G(t), 
t GM+). 
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Lemma 4.1. The process L is a zero-mean Gaussian process with tra- 
jectories in D(M+,Dc(M+,M)). Its covariance is given by 

EL{t,x)L{s,y) = a.{tAs)F'{x Ay). 

Furthermore, the pair (L, V) is Gaussian. 

Proof. By (4.1), (4.7) and Lebesgue's dominated convergence theorem, 
the definition of L{t,x) in (4.3) impUes that L{t,x) is right-continuous in x 
with left-hand hmits for a given t. Similarly, 



It follows that L has trajectories in D(R+,Dc(M+,M)) a.s. 

Since the integrand in the integral on the right of (4.3) is left-continuous 
in u, Lebesgue's dominated convergence theorem shows that this integral 
can be assumed to be a Stjeltjes integral, that is, to be a limit of Riemann 
sums. Since finite-dimensional distributions of V are Gaussian, it follows that 
finite-dimensional distributions of (L, V) are Gaussian too. The formula for 
the covariance of L is obtained by a direct calculation. □ 

Lemma 4.1 implies that L defines an orthogonal random measure on 
in that E\JL{{ti,xi),{t2,X2))OL{{si,yi),{s2,y2)) = 0, where ti <t2, 
xi < X2, Si < S2, and yi <y2, whenever the rectangles with the vertices 
{ti,xi),{ti,X2),{t2,xi),{t2,X2) and (si, yi), (si, ^2), (^2, yi), (^2, 2/2) are dis- 
joint. Similarly, EnL((ti, xi), {t2,X2)){L{0, ya) - L{0, y^)) = 0, EnL((ti, xi), 
(t2, X2))(L(S2, 0) - L(si, 0)) = 0, E(L(0, 2/2) - L(0, yi))(L(s2, 0) - L(si, 0)) = 
0, E(L(t2,0) -L(ii,0))(L(s2,0) -L(si,0)) = when (ti,t2) and (si,S2) are 
disjoint, E(L(0,X2) — L(0, xi))(-L(0, 1/2) — L{0,yi)) = when {xi,X2) and 
{yi,y2) are disjoint, EnL((ti, xi), (t2, X2))L(0, 0) = 0, B{L{t2,0) - L{ti,0)) 
L(0,0) =0, and E(L(0,X2) - L(0, xi))L(0, 0) =0. These properties enable 
us to define in a standard fashion integrals with respect to L. 

To recapitulate, suppose /i is a Borel function with 





(4.11) 




If 



k I 



h{s, x) 




(4.12) 



m 




1=1 



26 



A. A. PUHALSKII AND J. E. REED 



where the Oj, 6j, Cj and d are real numbers, < xi^i < X2,j, < yi^i < y2,i, 
< zi^i < Z2,i, and the sets (si,i,S2,i] x j;2,j], ?/2,j], and {zi^i,Z2,i] 
are pairwise disjoint, we set 

/ h{s,x)dL{s,x) = y^ ai\I\L{{si^i,xi i), (s2,i,X2,i)) 

I 

(4.13) +Y,bi{L{0,y2,^) - L{0,yi,i)) 

i=l 
m 

+ Ci{L{z2,i,0) - L(zi,i, 0)) + dL{0, 0). 



i=l 

Note that by Lemma 4.1 



(4.14) eT/ /i(s,x)(iL(s,x)^ =[ h{s,xfda{s)dF'{x). 
\JrI J Jul 

If h{s,x) is an arbitrary Borel function satisfying (4.11), then there exists a 
sequence h'' of functions of the form (4.12) such that 



hm / {h{s,x)-h''{s,x)yda{s)dF'{x) = 0. 

This imphes by (4.14) that the sequence f^2 h''{s,x) dL{s,x) is Cauchy in 

L2(r2,J^, P), so it converges. We define f^2 h{s,x) dL{s,x) as the hmit. One 

can see that the integral is a zero-mean Gaussian random variable and that 
(4.14) still holds. By polarization, if g{s,x) is another function with J^2 g{s, 

xY (ia(s) dF'{x) < oo, then 



E 

(4.15) 



h{s,x) dL{s,x) / g{s,x) dL{s,x) 

7r2 



h{s, x)g{s, x) da{s) dF\x). 



The martingale property asserted in the next lemma is understood with 
respect to the natural filtration. Recall that Gaussian martingales are locally 
square integrable. 

Lemma 4.2. Ifg{s,x) is a Borel function on such that, for allt G 
and X G R_)_, 

/ '^{s<t}'^{y<x}9{s,yf da(s) dF' {y) <oo, 

JR2 
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then the process N = {N{t),t € M+) with 

^it)= gis,x)l(g^^<adL{s,x) 

is a zero-mean Gaussian martingale with predictable quadratic variation pro- 
cess {N) = {{N){t),t£R+), where 

{N) {t) = [ g{s, x)\,+,^t} da(s) dF'{x). 

The process N has a modification with trajectories in D(R+,M). 

Proof. By construction, finite-dimensional distributions of N are limits 
of Gaussian distributions, so they are Gaussian too. The covariance of is 
given, according to (4.15), by 

EN{s)N{t) = [ g{s, x)H{^+,^,^t} dsi{u) dF'{x). 

It follows that N has uncorrelated, hence, independent increments. It is, 
thus, a zero-mean Gaussian martingale. By the independence-of-increments 
property, the natural filtration of N is right-continuous; see, for example, 
Doob [6], Part 2, Chapter VI, Section 8. Consequently, N admits a right- 
continuous with left-hand limits modification; see, for example, Doob [6], 
Part 2, Chapter IV, Section 1. □ 

Let 

(4.16) M{t)= j l{,+,<t}(iL(s,x). 

By Lemma 4.2, the process M = {M{t),t G M^) admits a modification which 
is a Gaussian martingale with trajectories from B(]R+,M). We further con- 
sider such a modification throughout. The variance of M{t) is given by 

(4.17) C{t)= [ a{t-s)dF'{s). 

Jo 

We study measurability properties of the introduced processes. Recall 
that H was defined in (3.17). 

Lemma 4.3. The processes H,G and M are separable random elements 
ofI])c(R+,R) and the processes L, L', U and V are separable random elements 
o/ Dc(IK+)ID)c(IK+>IK))- The pair {G,M) is Gaussian. The process G is a 
Gaussian semimartingale. 
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Proof. By the hypotheses of Theorem 2.2, the process y is a separa- 
ble random element of Dc(M+,M), so its distribution is a tight probability 
measure. By (3.17), H is obtained from Y by an application of a continu- 
ous operator on ][!)c(lR+) I^)- It follows that the distribution of is a tight 
probability measure, hence, if is a separable random element of Dc(I^+)I^)- 

Since the process V is bounded on bounded domains [see (4.1)], by (4.5) 
the process G is of locally bounded variation a.s. By (4.7) and Lebesgue's 
dominated convergence theorem, the trajectories of G are right-continuous 
and admit left-hand limits on a set of full probability. Since the integrand 
in (4.5) is a left-continuous function of y, the integral can be interpreted 
as a Stjeltjes integral, that is, as a limit of Riemann sums. As (L, V) is 
a Gaussian pair by Lemma 4.1, the definition of M in (4.16) implies that 
(G, M) is a Gaussian pair. 

Hence, the processes G and M are Gaussian semimartingales with paths in 
B(M_|_,R). By Liptser and Shiryaev [16], Theorem 4.9.1, their jump times are 
deterministic, so the ranges of these processes as elements of Oc(M_|„,]R) are 
separable. Since balls in Dc(M+,R) belong to the Kolmogorov u-algebra, the 
traces of the Kolmogorov and Borel cr-algebras on a separable set coincide, 
hence, G and M are separable random elements of Dc(M+,M). 

By (4.2) and continuity of the Kiefer process in both variables, U{t,x), as 
a function of x, jumps only when F jumps, so its range is separable, hence, 
{U{t,x),x G M4.) is a separable random element of Dc(I^+)I^) for each t. 
Next, the map t ^ {U(t,x),x e M+) from R+ to Bc(M+,M) is continuous, so 
U has a separable range in Bc(K_|_,Bc(M_|_,M)). It is, therefore, a separable 
random element of the latter space. The process F is a separable random 
element of Dc(IR+) II5c(lR+) I^)) for a similar reason. 

The range of {L{t,x),x G M+) for a given t is separable by the fact that 
the jumps of {L(t,x),x E M+) occur at the times of jumps of F, hence, 
this process is a random element of Bc(M+,M). Since the jumps of L as an 
element of Bc(M+,Dc(l^+;I^)) coincide with the jumps of a, it is a separable 
random element of Bc(M+,Bc(M+,M)). 

The assertion of the lemma for L' is obtained analogously. □ 

In what follows, we always assume the modifications as described in Lem- 
mas 4.2 and 4.3. 

We now construct the process Z = {Z{t),t G M^_) in the statement of 
Theorem 2.2. We define 

(4.18) Z{t) = G{t)-M{t). 

By Lemma 4.3, Z is a Gaussian semimartingale, so it is a separable random 
element of Bc(M+,M). In order to verify that its covariance function has 
the form stated in Theorem 2.2, we find it convenient to approximate this 
process with Gaussian processes of simpler structure. 
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For Z G N, let = Sq < s\ < S2 < ■ ■ ■ be a strictly increasing to infinity 
sequence of real numbers. Following the notation used in the Introduction, 
we set, for t £ R_|_, 

00 

(4.19) ^lA^' ^) = '^^{s€{sl_„s\]}'^{0<x<t-sl_J + l{s=0}l{0<x<t}- 
1=1 

We also define 

Ii^tis,x)dV{s,x) 
(4.20) 

= J](F(4, t - si,) - V{sl„t - sU))l{4_,<t} + ^(0, t) 

i=l 

and introduce 

(4.21) Zi{t) = - [ Ii,t{s,x)dV{s,x). 

On recalling (4.1), we see that {Zi{t),t G M+) is a zero-mean Gaussian pro- 
cess with covariance 

00 

BZi{t)Zi{s) = 5^(a(s^) - a(4„,))F(t A s - 4_,) 

i=l 

(4.22) x(l-F(tV5-sti))l{4_,<iAs} 

-fa(0)F(t As)(l -F(t Vs)). 

Lemma 4.4. If supj(,s- — s[_-^) — )■ as I ^ 00, then the Zi{t) converge 
to Z{t) in the mean square sense for each t as / —t- 00. The covariance of Z 
is given by 

ptAs 

BZ{t)Z{s)= / F{tAs-u){l-F{tVs-u))dai{u). 
Jo 

Proof. By (4.3), (4.13), (4.19) and (4.20), 

Ii^t{s,x)dV{s,x) = / Ii^tis,x)dL{s,x) 

(A 9.^ 1 r^'-' V{s[.y-)-V{sU.y-) . 

(4-23) - 1{4_,<*} l-F{y-) 

^-F{y-) 
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Given e > 0, for all I large enough, l{s+x<t}l{s>o}l{x>o} < Ii,t{s,x) < 
l{s+x<t+e}^{s>o}^{x>o} ■ Therefore, 

{Ii,t{s, x) - l{s+x<t}f da.{s) dF'{x) 

2 L _ J 

+ f 2 

< / {l{s+x<t+e}-'^{s+x<t}) da{s)dF{x). 

The right-hand side converges to zero as e — )• 0, so by (4.16) and the definition 
of the integral 

(4.24) M(t) = l.i.m. / Ii t{s,x) dL{s,x), 

where l.i.m. stands for mean-square limit. Also 

f'-''-^ v(4.y-)-v{4-i.y-) , , f v(o,y-) , 

'^'^ dF{y), 



where s-^^^ > t — y > By right continuity of V{t,x) in t, (4.5), (4.^ 

and Lebesgue's dominated convergence theorem. 



(4.25) 

V{0,y- 



-dF{y) 



l-F{y- 

where P-lim denotes limit in probability. 

By (4.18), (4.21), (4.23)-(4.25), Z{t) = ¥-\iuii^^ Zi{t). Since the Zi are 
Gaussian processes, the latter limit holds in the mean square sense too; see, 
for example, Ibragimov and Rozanov [11], Lemma 1.3.1. 

By (4.22), we can write 

roo 

^Zi{t)Zi{s) = Fit As- r'(n))(l -F{tVs- r'(n)))l{,,(„)<,^,} da(tx), 
JO 

where 

oo 

"'N = X] ^i-i^{"e(4_i,4]}- 



r 

1=1 

Since maxj(s' — s[_i) — )■ as / — )• oo, r\u) — )■ u from the left. By right conti- 
nuity of F, F{tAs- r\u)) -^F{tAs-u) and F{tVs- r\u)) -^F{tVs-u) 
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as / — oo. Also, l{r-'(u)<tAs} ~^ l{u<iAs}- Therefore, by Lebesgue's dominated 
convergence theorem, 

ftAs 

\im EZi{t)Zi{s)= F{tAs-u){l-F{tVs-u))dsL{u). ^ 



4.2. Convergence in distribution. Let 

[nt\ 



(4.26) U^{t, x) = ^ J2(^H<-} - ^(^))' 

(4-27) ^'"(M) = ^E(lte<.}-y^ Y 



F(u- 
By (3.1) and (4.26), 

(4.28) V''it,x) = U"(^^-^,xy 

For what follows, we note that, given arbitrary T > and 6 > 0, 



lim lim sup P ( sup sup 



(4.29) 

= 0. 



The limit in (4.29) is analogous to that in equation (3.23) in Krichagina and 
Puhalskii [15] [see also (3.24) in that paper], so a similar proof applies. 

We introduce the processes L'" = ((L'"(i,x), x G ]R+),t € M+), = ((C/"(i, 
x),xE]R+),t gM+), and L' = {{L'{t,x),x £R+),t £R+). 

Lemma 4.5. As n— )-oo, the (Xq C/"',L'") converge jointly in dis- 
tribution inRx Bc(M+,M) x Bc(]R+,ID)c(K+,lR))^ to {Xq,X,U,L'). 

Proof. Recall that, by Lemma 4.3, L' and U are separable random ele- 
ments of the space I[])c(M+,ID)c(IK-i-,IK))- The process X is a separable random 
element of Dc(]R+iIK) by (3.20) and the assumption that S is a separable 
random element. The hypotheses of Theorem 2.2 and (2.2c) imply in a stan- 
dard fashion that the (Xq ,X") converge in distribution in R x Dc(M+,M) to 
(lo,^). 

Since (X^,X") and (C/",L'") are independent and {Xq,X) and {U,L') are 
also independent and are separable random elements of the associated metric 
spaces, by Theorem D.8 it suffices to establish convergence in distribution 
in Dc(K+,Bc(K+,M))2 for (C/",L'"). By (4.26) and (4.27) (cf. (3.5)), 

(4.30) C/"(t,x) = - r El^l^ dF{u) + L'^{t,x). 

Jo l-F{u-) 
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Let 

\nt\ 

(4.31) i^'^(t,x) = -=j;(l{^,<,}-x), 

where the C,i are independent and uniform on [0,1]. By Krichagina and 
Puhalskii [15], the = {{K'^{t,x),x e [0, l]),t G M+) converge to K in dis- 
tribution in B(M4.,B([0, 1],M)). Since K is continuous in both variables, it 
fohows that the convergence takes place in Bc(M_(_, Dc([0, 1], M)) too. (One 
can apply Corollary D.l.) Since by (4.26), we can assume that U^{t,x) = 
K"-{t,F{x)), the [/" converge in distribution in Bc(]R+, ID)c(lR+, K)) to the 
process U. 

Let, for e £ (0,1), 

TJ^if y-) 

L'^it, x) = U{t, x) + £ ^^^^^^~i^ l{F(n-)<i-.} dF{u), 

l>n,e ^ ((^L"''%t,x),x£ M+),t G M+), and L'^ = {{L'%t,x),x£ M+),t G M+). 
An argument analogous to the one used in the proof of Lemma 4.3 shows 
that L'^ is a separable random element of Bc(M+, Bc(M+, R)). The continuous 
mapping principle (see Theorem D.l) yields the convergence in distribution 
in Bc(IR+,Bc(M+,M))2 of the (C/",L'"'^) to (C/,L'^). Thus, in view of (4.9), 
(4.30) and Theorem D.IO, the result follows by (4.29). □ 

Lemma 4.6. Asn^oo, the {Xq,X^,H^,G^,L^,V'^) converge in dis- 
tribution inRx Bc(M+,M)^ x Bc(M+,Dc(IR+,M))^ to {X,X,H,G,L,V). 

Proof. By Lemma 4.3, the processes H, G, L, V and U are sepa- 
rable random elements of the associated function spaces. Since the exoge- 
nous arrival process i?" and (Xq ,X'^,C/",L'") are independent, on the one 
hand, and Y and (Xo,X,U,L') are independent, on the other hand, and 
are separable random elements. Lemma 4.5, the hypotheses of Theorem 2.2, 
and Theorem D.8 imply that the {Xq,X"',Y"',U"',L'"') converge in distri- 
bution in M X Bc(]R+,M)2 x Bc(M+, Bc(M+, M))^ to {Xo,X,Y,U,L'). Since 
the random element {Xo,X,Y,U,L') is separable, by Theorem 2.1 and Slut- 
sky's lemma (Theorem D.9) the (X^, X", F", iJ'^, L'", ^"/n) jointly con- 
verge in distribution in M x Bc(]R+,M)2 x Bc(]R+,Dc(IR+,M))^ x Bc(M+,IR) 
to {Xo,X,Y,U,L',a). On recalling that y"(t, x) = ;7"(^"(t)/n, x), V{t,x) = 
U{a{t),x), L"(t,x) = L'"(A"(t)/n,x), and L(t, x) = L'(a(t), x) [see (3.4), 
(4.1), (4.4), (4.27) and (4.28)], we conclude by the continuous mapping prin- 
ciple (Theorem D.l) that the (Xq , X", F", V"", L") converge in distribution 
in M X Bc(M+,M)2 x Bc(M+,Bc(M+,]R))2 to {Xo,X ,Y,V,L). 
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Let, for e G (0,1), 

Qn,e ^ (G'^,^(t)^t e and = (G-'(t),t G M+). We note that the G"" are 
separable random elements of Dc(I^-i-;lK)- On applying the continuous map- 
ping principle and recalling (3.18), we have that the (X^, X"", L", F") 
converge in distribution in M x Dc(M+, M)^ x Bc(K+, ID)c(K+, M))^ to {Xo,X, H, 
G^,L,V). In view of Theorem D.IO, (3.7), (4.5) and (4.8), the assertion of 
the lemma will follow if for arbitrary T > and 5 > 0, 

The latter hmit is implied by (4.28) and (4.29). □ 
Let, for e > 0, 

(4.32) M"'^(t)= / l{A.is)AF{x)>e}^{s+x<t}dL''{s,x) 

and 

(4.33) M^{t)= I l{A^[s)AF(x)>e}'^{s+x<t}dL{s,x). 

We note that these two integrals are, in fact, finite sums: 

(4.34) M^'^{t)= Yl aL^iis-,x-),is,x)) 



lim lim sup P I sup sup 

£^0 n-i>oo \tG[0,T]a;eM+ 



s,x:s+x<t, 
Aa(s)AF{x)>£ 



and 



(4.35) M%t)= Yl aL{{s-,x-),{s,x)). 

s,x:s+x<t, 
Aa.{s)AF{x)>e 

In particular, = {M^{t),t G M+) is a separable random element of ]D)c(IK-i-) 
R) and M"'*^ = (M"''^(t),t G R+) is a continuous function of L" for spaces 
]D)c(IK+,IK) and Dc(R+,Bc(R+,R))- 

Lemma 4.7. Given h <■■■ <tmeR+, asn^oo, the (X^, X*^, iJ", G", 
M^'-'^,M'^{ti),...,M'^{tm)) converge in distribution in M x Bc(M+,M)'^ x 
to (Xo,X,/7,G,M^M(^l),...,M(^„,)). 
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Proof. Since = G"(t) - M"(t) by (3.6) and Z{t) = G{t) - M{t) 

by (4.18), the continuous mapping principle implies that it suffices to prove 
that the (XJ, X", if", G", M"'^ Z"(ti), . . . ,Z"(tm)) converge in distribution 
in M X Dc(M+,M)^ x to (Xq, X, ii, G, MS Z(ti), . . . , Z(t;n)). 

Let = Sq < s'^ < §2 < • • • be such that — )■ oo as A; — )• oo and supj^j^ 2 ...{^\~ 
s\_i) — )• as / — 7- 00. Recall that the function Ii^t and the process Zi = 
{Zi{t),te M+) are defined by (4.19) and (4.21), respectively. We also set 



(4.36) Zr{t) = - / I^{s,x)dV''{s,x), 

Jul 

where the integral on the right is defined in analogy with (4.20), that is, 

„ 00 

/ I^{s,x)dV-{s,x) = Y,hs{ ,<t}iV''i4,t-sl,)-V-{.sl„t-sl,)) 
■^^+ i=i 

+ y"(o,t). 

Lemma 4.6, (4.34), (4.35) and the continuous mapping principle yield conver- 
gence in distribution in M x Dc(K+, K)^ x M'" of the {X^, X", i?", G", M"'^ 
Z]'{ti),...,Zf{tra)) to {XQ,X,H,G,KF,Zi{ti),...,Zi{t^)) as 71^00. By 
Lemma 4.4, for arbitrary t G and 7 > 0, 

limP(|Z(t)-ZKt)|>7) = 0. 

It thus remains to prove that, for arbitrary t G and 7 > 0, 

(4.37) lim limsupP(|Z"(t) - Zj'{t)\ > 7) = 0. 

By (3.1), (3.3) and (4.36), for s G R+, 
Z-{s)-Zns) 

V i=l j = l 

X (ite.(s-.r.-4-J} - (^(^ - 4-1) - - rn)). 

For /c G N, introduce 

^ A"{s)Ak 00 

i=l j=l 

X (l|,^e(s-rr,.-.'_,]} - (Hs - 4-i) - ^(^ - 
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Since the A'^{s)/n converge to a(s) in probability as n — )• oo by Theorem 
2.1, (4.37) would follow by 

(4.38) hm limsupP(|Z,';fc(t)| > 7) = 0. 

(-S-00 ri_!.oo 

Let be complete cr-algebras generated by the random variables r" A 
Ta"(s)+i ^jAA"(s)i where j G N. By Bremaud [4], Appendix A3, Theo- 
rem 25, the flow F" = (-F",s G M+) is right-continuous, so it is a filtration. 
By part 4 of Lemma C.l (see also Lemma 8 in Reed [22] and Lemma 5.2 
in Krichagina and Puhalskii [15]), the process (Z"^(s),s G M+) is an F"- 
square integrable martingale with predictable quadratic variation process 
((Z/;^)(s),sGM+), where 

A"{s)Ak 00 

i=i j=i 

x(l-(F(.-4_i)-F(.-rn)) 

= -Ei{^' ,<s} / "'(^"(4As)-^"(^-x))di^(x). 

j=i -^"-"j 

In view of the compact convergence in probability of the A"/n to a as n —t- 00 
(Theorem 2.1), the latter sum converges in probability as n —t- 00 to 

E^H i<4 / , (a(4 As)-a(s-x))dF(x) 

00 

= E hs]_,<s}iF{s - 4„i) - F((. - 4)+))a(4 A s) 

— / a(s — x) dF{x) 
Jo 

= / a{u\s-x))dF{x)- / a(s- j;)dF(x), 
Jo Jo 

where n'(x) = ^°^iS^.Asl|,i_^<,}l|^g[,i_^ ,i)l for x G [0,s].Note thatM'(x) > 

X and n'(x) — t- 2; as / — t- 00. Hence, u'(s — x) — t- s — x from the right, so 
a(u'(s — x)) — )• a(s — x). By Lebesgue's dominated convergence theorem. 
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Jq a(ti'(s — x)) dF{x) — )■ /q* a(s — x) dF{x) as / — )■ oo. We conclude that, for 
arbitrary (5 > 0, 

lim limsupP((Z;;,)(t)>J)=0. 

Limit (4.38) follows by an application of the Lenglart-Rebolledo inequality; 
see, for example, Liptser and Shiryayev [16], Theorem 1.9.3. □ 

Lemma 4.8. As n ^ oo, the (XJ,X",iJ",G",M"'SM") converge in 
distribution m M x Bc(M+,M)'^ x ro(]R+,R) to {Xo,X,H,G,M^,M). The lat- 
ter random element has a tight distribution. 

Proof. Let us show that the sequence is tight in ]D)(IR+,]R) (for 
Skorohod's Ji-topology). By Lemma 3.1, the process M^2 is a G^-square 
integrable martingale with predictable quadratic variation process 



(M-,)(t)= / l|,+,<,|d(L;^,)(s,x) 

A"(t-x)An" 



f 1 l-F{x) 
in ^ Mo<^<v.}^^_p^^_-^ydF{x). 



i=l 

Since the A^/n tend to a in probability uniformly over compact sets, by the 
law of large numbers and (4.10), for T > and 6 > 0, 

(M„".)(t) 



lim P( sup 

vte[o,T] 



/ ^x>o}^{t - x) dF' (x) 
Jo 



>6\=0. 



By Theorem VI. 5. 17 in Jacod and Shiryaev [12], the sequence M^a is tight 
in ]D)(M+,M). Since the A^/n converge in probability to a, the definition of 
V"'{t,x) in (3.1), Donsker's theorem, Slutsky's lemma (Theorem D.9) and 
the continuous mapping principle imply that the sequence V"' = {V^{t, 0), t G 
M+) converges in distribution in Dc(M+,M) to (v^F(0)(l - F{0))W{a{t)),t £ 
M+), where {W{t),t G M_(_) is a standard Brownian motion. Thus, this se- 
quence is asymptotically tight in Dc(IK+iIK) (Theorem D.3). By Theorem 
D.7, the sequence {V'^,M^2) is asymptotically tight in Dc(IR+,IR) x D(IR+,M). 
Since the map (x,y) — t- x + y is continuous as a map from Dc(M+,M) x 
D(M+,]R) to B(]R+,M), it follows that the sequence + ikPa is asymptot- 
ically tight in B(M+,R), see Theorem D.4. By Ulam's theorem, + M^a 
is a tight random element of B(M_|_,M) for each n. Therefore, the sequence 
yn ^ j^jn^ jg ^jg|^^ -^^ D(M+,IR), van der Vaart and Wellner [23], Problem 
1.3.9. Since, for T > 0, by (3.9)-(3.11), 

P( sup |M"(t)-y"(A"(t)/n,0)-M^2(t)|>0) <P(A"(T)>n2) 

^t6[0,T] ^ 
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and the latter probability tends to zero as n — )■ oo, it follows that the se- 
quence M" is tight in D(M_|_,]R) (e.g., by Theorem VI. 3. 21 in Jacod and 
Shiryaev [12]). 

By Lemma 4.7, the (Xq, X"-, i?", M"'*^) converge in distribution in M x 
Dc(IK+)IK)^ to {Xo,X,H,G,M^), which is a separable, hence, tight, random 
element (recall the definition of X in the statement of Theorem 2.2, Lemma 
4.3, and (4.35)). Therefore, the sequence (X^, X", if", G", M"'^) is asymp- 
totically tight in M X Dc(M+, M)^, see Theorem D.3. Since the sequence M" is 
tight in D(R+,M), it follows that the sequence (X^, X", if", G", M"'^ M") 
is asymptotically tight in R x Dc(M+,M)'^ x D(M+,M), see Theorem D.7. 

Since the topology of M x B(M+,M)^ is coarser than the topology of M x 
Dc (IR+ , K) X B (M+ , M) , the sequence (X^ , , iJ" , , M"'^ M" ) is asymp- 
totically tight in M X D(M+, ]R)^ It is thus tight because the (XJ, X", F", G", 
M"'''^,M"') are random elements of M x B(M+,M)^, see van der Vaart and 
Wellner [23], Problem 1.3.9. Lemma 4.7 and Prohorov's theorem imply that 
the (X^,X",i^",G",M"'^M") converge in distribution in M x B(]R+,]R)5 
to {Xq,X, H, G, ,M). On taking the set of Skorohod-continuous bounded 
functions as the separating subalgebra in Theorem D.6 we conclude that 
the sequence (Xq , X", i/", G", M"'*^, M") is asymptotically measurable in 
R X Dc(R+,R)'^ X D(R+,R). The latter property, coupled with the asymp- 
totic tightness of this sequence in R x Bc(R+,R)'^ x B(R+,R), yields by 
Theorem D.5 the existence of a subsequence that converges in distribution 
in R X Bc(R+,R)'' x B(R+,R) to a random element with a tight probabil- 
ity law. The limit must be the same as in R x D(R+,R)^, that is, it is 
(Xq, X , H,G, M'^ , M). It thus does not depend on a subsequence. □ 

4.3. Completion of the proof of Theorem 3.1. Let 



be the decomposition of the Gaussian martingale M into the sum of a contin- 
uous Gaussian martingale Mi = {Mi(t),t G R_|_) and a pure-jump Gaussian 
martingale M2 = {M2{t),t G M4.) with jumps occurring at the jump times 
of G(t); see Jacod and Shiryaev [12], Chapter II, Section 4d, Liptser and 
Shiryayev [16], Chapter 4, Section 9. Formally, 



(4.39) 



M{t) = Mi{t) + M2{t) 



(4.40) 





Let also 



(4.41) 



M'%t) = M{t)- M^{t). 
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We show that, for T > and 5 > 0, 

(4.42a) Urn P ( sup \M%t) - M2it)\ > 6) = 0, 

Vg[o,t] ^ 

(4.42b) hm P ( sup \M'%t) - Mi{t)\ > 6) = 0. 

He[0,T] ' 

Since by (4.17) AC(t) = E.+..=t Aa(s)AF'(x), by (4.16), 

M2{t) = / l{Aa{s)AF{x)>0}'^{s+x<t}dL{s,x). 

Jul 

Hence, by (4.33) and (4.40), 

M2{t)-M%t) = / l{o<:A8i{s)AFix)<e}'i-{s+x<t}dL{s,x). 

Lemma 4.2 imphes that (M2(t) — M^{t),t £ M_|_) is a Gaussian martingale 
relative to the natural filtration with predictable quadratic variation pro- 
cess {Jjg^2^'\-{o<Aa(s)AFix)<e}'^{s+x<t}da{s)dF'{x),t eR+). The latter func- 
tion tends to zero as e — t- for every t G M4., so the Lenglart-Rebolledo 
inequality yields (4.42a). The hmit in (4.42b) follows by (4.41), (4.42a) and 
the identity in (4.39). 

We introduce processes M'"'^ = {M''"-'%t),t G M+) by letting M'"'=(t) = 
M"(i) - M"'=(t). Let also M'^ = {M'%t),t G M+). By Lemma 4.8 and the 
continuous mapping principle, as n — )• 00, the {Xq, X"-, H^, G", M"'"^, M'^'^) 
converge in distribution in R x Dc(K+, 1^)^ x D(M+, M) to {Xq,X, H, G, ]VP,M'^). 
The latter random element has a separable range. Therefore, by Theorem 
D.ll, 

hm dlr ( (1" , X" , , G'^ , M"'^ ,M"'''),{Xo,X,H,G,M',M")) = 0, 

where dgL^ is the distance on the space of mappings from to M x Dc(M+, R)^ x 
D(M+,M) as defined in Appendix D. The limits in (4.42a) and (4.42b) imply 
that lim,_,o rf^Li ((^0, X, H, G, M', M'^), (Xq, X, H, G, M2, Mi) = 0, so 

lim hm sup ( (Xq" , X" , , G" , M"'^ M'"'^ ) , (Xo , X , i7 , G, Af2 , Ml ) ) = 0. 

£—^0 n— !>oo 

Therefore, there exists a sequence e,i — )• such that 

hm d^j^^ ((Xo^ X^ G", M"'^", M'"'^"), (Xq, X, H, G, M2, Mi)) = 0, 

which implies by Theorem D.ll that the (XJ, X", iJ", G", M*^'*^", M'"'^") 
converge in distribution in M x I])c(K+, I^)"^ x D(M+, R) to (Xq, X, H, G, M2, Mi). 
Since the process Mi has continuous paths and convergence in Skorohod's 
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Ji-topology to continuous functions is equivalent to compact convergence, 



by Corollary D.l the (X^, X", G", M"''^", M'"'^") converge in distribu- 
tion in M X Bc(M+,M)^ to (Xo,X,i7,G,M2,Mi). By the continuous map- 
ping principle, the {Xq , , , G"' — M"'*^" — M'"'^") converge in distribu- 
tion in M X Dc(M+,M)^ to {Xo,X,H,G- Mi - M2). Recalling that = 
j^n,e j^>n,e^ = G" - M", M = Mi + M2, and Z = G - M completes 
the proof of Theorem 3.1. 

APPENDIX A: EXISTENCE AND UNIQUENESS FOR THE 



We prove existence and uniqueness of solutions to (2.2a)-(2.2c). 

Lemma A.l. Given a nondecreasing nonnegative integer-valued process 
E"' with trajectories inB(M+,M), a nonnegative integer-valued random vari- 
able Qq, and sequences of nonnegative random variables {r]i} and {fji}, 
there exist nonnegative integer-valued processes and and nonnega- 
tive integer-valued nondecreasing process with trajectories in D(]R_|.,IR) 
such that equations (2.2a)-(2.2c) are satisfied. The process is specified 
uniquely. If r]i > for all i, then the processes and are specified 
uniquely. 

Proof. We fix cj G throughout. Obviously, Q"" is specified uniquely 
by (2.2c). For and we start with the case where Qq < n. First, the 
existence issue is addressed. Introduce the process Q"'^ = (Q"'^(t),t S ffi+) 
as the process of the number of customers in the infinite server with the 
same arrival and service times and the initial number of customers, that is. 



Let r^^'i = inf{i:Q'^'i(t) > n} < 00. Suppose r"'i > 0. We define Q'^(t) = 
and = E'^it) for t < r"'^ Obviously, equations (2.2a) and 

(2.2b) are satisfied for t < r"'^. 

If r"'^ = 00, the proof of existence is over. Suppose the contrary. Clearly, 
r"'-^ is a jump time of E^. We choose A"(r"'-^) such that 



QUEUEING EQUATIONS 



(A.l) 






i=£;"(T"'i-)+i 



(A.2) 



= n — 
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It exists and is not greater than E^{t'^'^) due to the facts that (5"(t"'^— ) < n 
and that Q"'i(r"'i) > n, so by (A.l), 

Q'.(t"^i_) + A(5"(t"-1) + A£"(t"-1)- Y. l{x~+«=r"..) 

(A.3) 

i=_E"(T"'l-) + l 

We also let 

(A.4) Q"(r"'i) = n + ^"(t"'^) - A"(t"'^). 

Hence, Q"(r"'i) > n, so (2.2b) holds for t = t"'1. By (A.2) and (A.4), 
Q"(r"'i) = Q"(r"'i-) + A^"(t"'^) + AQ"(r"'i) 

(A.5) 

i=l 

We obtain that equations (2.2a) and (2.2b) are satisfied on [0,t"'"'^]. We next 
extend the construction past r"'^. Let us define a nondecreasing nonnegative 
integer-valued process A"'^ = (A"'^(f),f € M+) with right-continuous trajec- 
tories admitting left-hand limits and with A"'^(0) = by specifying its jumps 
A^"'2(i) for t > as fohows: 



AA"'2(t) =inf<^ A:GN: ^ l,„n,2 



yl"'2(t-) + fc 

'{'yr''>o} 



I, i=A"'2{t-) + l 

(A.6) 



where r"'^ = inf{t : A"'^(t) > i}, r/"'^ = ?7j_,_^n(^n,i), and 

(A.7) Qn,^^t)=Q^{t + T'^'^)+ J2 l{rr+r,,M+r-l}. 

i=l 

It follows by (A.l) and (A.2) on recalling that Q"(r"'i-) = Q'^'i(r"'i-) and 
A'^(r"'i-) = ^"(t"'1-) that Q"'2(0) = ?i and Q^'^it) < n for t > as the 
right-hand side of (A.7) is decreasing in t. 

In words, j4"''^(t) is the number of customers that enter service by time t 
for an n-server queue that always has a nonzero queue length and for which 
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residual service times of customers in service at time are those of customers 
in the n-server queue under consideration at time r"'^ and the service times 
of customers entering service after time zero are equal to the service times 
of customers entering service after time r"'^ in the queue in question. We 
note that this process can run away to infinity on finite time. (For instance, 
if Q"'''^{t) has its first jump at s > and r/"'^ = for ah i, then A'^''^{t) = oo 
for t> s.) We therefore introduce f"'^ = sup{t : < oo} and note that 

fn,i > by the right continuity of Q"'^- 
By (A.6), we have for t < f"'^ that 

1=1 

so, since (5"'^(0) =n, 

A"'2(t) 

(A.8) Yl l{r-VCSt}+^"''W="- 

1=1 

Introduce 

(A.9) a"'^ = mi{t : A'^'^it) > Q"(r"'i) -n + {E''{t + r^^'^) - ^"(r'^'i))}. 

By right continuity of A"'^, cr"'^ > 0. Also, u"'^ < f"'-^. Intuitively, d"'^ is 
the time when and A"-(t + T"''^) — A"(t"'^) diverge. To substantiate 

this, define for t G [r"'\r"'i + a"'^), 

= Q"(r"'i) -n + Q'^'^t - r"'i) + - ^"(r"'i)) 

(A.IO) 

E l{r;^'2+^;^.2<t-r",l}- 
1=1 

By (A.8), we can also write 

(A.ll) Q'^it) = g"(r"'i) + (^"(t) - S"(t"'1)) - A'^'^it - r"'i). 
Therefore, Q"(t) > n by (A.9), and by (A.4), 
(A.12) Q"(t) = n + S"(t) - ^"(r"'i) - ^"'2(4 - r"'^). 

On letting 

(A.13) A"(t) = A"(r"'i) + A"'2(t - t"'1), 

we can see that (2.2b) holds on [r"'i,r"'i + 0""'^). To obtain (2.2a), we 
substitute (A.4) in (A.IO) and recall the definitions of t^'"^, rj^''^ and Q^'^{t). 
If a^'^ = oo, the proof of existence is over. If a"'^ < oo, we let 

(A.14) A^"(r"'i + a"'^) = Q"((t"'^ + a"'^)-) - n + A^"(r"'i + d"'^) 
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and 

-\n/_n,l I _n,l\ a zpn/^n,! , _n,l 



A"'2(o-":l-)+A^"{r"'l+(T"'l) 



We note that by (A. 11) and (A. 14), 
A^"(r"'i+a"'i) 

(A.16) 

= Q"(r'''^) - n + (^'^(r'^'^ + a"'^) - ^"(t"'^)) - ^'^'^(a'^'i-), 

so by (A.9) 

(A.17) < AA"(r"'^ + fj"'i) < A^"'2((j"'^). 

Let us show that (5"(t"'^ + 0""'^) < n. By (A. 6) and the right-hand inequality 
in (A.17), 

i=A".2(o-".i-)+l i=l 

SO 

A"'2(cr">l-)+AA"{T"'l+(7"'l) 

A^"(r"'i + a"'i)< 1{.-V.r^=.-H 

(A.18) 

- AQ"'2(a"'^), 

and by (A.15) and (A.14), 

AQ'^(t"'1 + d"'^) < A^"(r"'i + (7"'i) - A^"(r"'^ + cj"'^) 

(A.19) 

= n-Q"((T"'i+cj"'i)-). 

Hence, Q"(r"'i + 0-"'^) < n. 

Also, Q"(r"'HCT"'^) > which is shown as follows. By (A.15) and (A.16), 

yl"'2(o-n,l_) 



5Z l{rr'VC'='^"'4 + AQ"'2(ct'^ 
i=l 

X] l{rf '2+7?7'2=<7".l} + AQ"'^(o-'"'^). 



n 

1=1 
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Since -Ag"'2((7"'^) < ^"'^((t"'^-), we have by (A.8) that 

A"'2(o-"'i-) 

i=l 

A"'2(<j".l-) 

The required inequahty has been proven. 

By (A.14), (2.2b) for t < r"'i + a"'\ and the inequahty Q"((t"'1 + 0-"'^)-) > 
n, AA"(r"'i + o-"'i) = ^"(T"'^ + f7"'^)-^"((T"'^ + a"'^)-). Wethus have (2.2b) 
for t = t"'1 + 0-"'^. Equation (2.2a) for t = t"'^ + cr"'^ follows by (A. 15) 
and (A. 7). Existence has been proven on [0,r"'^ +0""'^]. 

At time r"'^ + o""'^, we are in a similar situation to the one we faced at 
t = 0. We can thus define r"'^ and a"'^ and proceed until we get to the 
desired time t. This is bound to happen after a finite number of steps the 
reason being that in any interval [Yl%\ ('^"'■' + f^"'^ ) , (^"'^ + (^"'^ ) + "^"'1 : 
where cr"'^ = by definition, we have at least one upward jump of E^. Since 
i?" is finite- valued, there are only finitely many such intervals on any interval 
[0,t]. 

We now prove uniqueness. Thus, we suppose that Q" and A" satisfy (2.2a) 
and (2.2b) and that r]i> for all i. Assume for the moment that r"'^ > 0. If 
Q"" and differed from those defined above on [OjT"'^), then there would 
exist t' < r"'^ with Q^{t') > n. We note that t' > which is checked as 
follows. By (2.2a) and (2.2b) for t = 0, 

A"{0) 

Q"(0) = Q-(0) + (Q-(0) - n)+ + ^"(0) - J2 Mm=o} 

1=1 

<g"(o) + (g"(o)-n)+ + i?"(o)- J2 Mm=o} 

1=1 

= (Q"(0) - n)+ + Q"'i(0) < (Q"(0) - n)+ + n, 

so Q"(0) <n. 

For f"'i = inf{t < r^'^ : Q"(t) > n} G (0,oo), we would have that Q"(t) = 
Q"'i(t) and ^"(t) = E''{t) when t < f^'K Also, ^'^(f'^'^) < ^'^(f'^'^). Since 
by (2.2a) and (A.l), 

Q"(f"'i) = Q"'i(f "'!) + J] l|,^=o} <n + E^'if'^'') - A"(f"'^), 

i=A"(f".i)+l 
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we arrive at a contradiction with (2.2b). We have thus proved that a solution 
to (2.2a) and (2.2b) is specified uniquely on [0,t"'^). 

Next, (2.2a) and (2.2b) imply (A.5), so by (A. 3) and the inequality £;"(t"'1) > 
^n,i(^n,i) Yiave that Q"(t"'^) > n, and (2.2b) implies (A.4). Also, (A.4) 
and (A.5) imply (A. 2). Since r]i > 0, the latter condition specifies A"{t^'^) 
uniquely. Uniqueness on [0,r"'^] follows. 

We now show that Q"(t) > n for t G [r"'i,r"'i + a"'^). Let = inf{t > 
^n,i . Qn(^f^ ^ ^1 g^]^(^ suppose that (j'"'^ < r"'^ + a^'^. By right continuity of 
Q", we have that a^'^ > r"'i. By (2.2b), for t G [T"'\a"'i), 

(A.20) A"(t) - A"(r"'^) = S"(t) - ^"(r"'i) + Q"(r"'i) - Q'^(t). 

Since by (2.2a) and (A.7) for t > t"'1, 

Q"(t) = Q"(r"'i) - n + Q"'2(t - r"'^) + (S"(t) - ^"(r"'^)) 

(A.21) 

X] ^{r^+V^<t}^ 
i = A"(T". i) + l 

we have that, for t G [r"'^, a"'^), 

(A.22) Urr+V.>t} Q'^'Ht - T"'l), 

i=A"(r".l) + l 

SO that 

A"(t) 

i = A"(T"'l) + l 

Consequently, if t is a jump time of A", then 

A"(t) A"(t-) 

i=A"(t-) + l j=A"{r"'l) + l 

It follows by (A. 6) and the assumption that r)i> that A"(i) — 74"(r"'^) = 
A"'^(i — r"'^), which implies that Q^{t) is given by the right-hand side of 
(A.IO) (or the right-hand side of (A.ll)) for t G [r"•^ cr'^'^). Besides, a"'^ - 

We also have by (2.2b) since Q''(a"'i) < n, that A"(a"'i) - ^"(r"'^) = 
^n(cr".i) _ ^"(r"'i) Q"(r"'i) - n, so by (A.21) with t = a"'^ 

A"(5-"'i) 

E1 /^nf~n,l\ /\n,2i~n,\ _n,l\ 

l{r;^+»?»>'^"'i} = y (o^ ' )-y ' (cT ' -r ' ) 

i=A"(T"'l) + l 

<?i-Q'^'2(a'^'i-r'^'i). 
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It follows by (A. 22) on noting that a"'^ is a jump time of that 

A"(o-".i-)+l i=A"{T".i)+l 

so by the fact that ^'^(t) - A"(r"'i) = - r'^-i) for i < a^'^ and (A.6), 

A^"(cr"'i) < A^'^'2(a"'^ - r"'i). Therefore, 

X] l{rr+-'?.<5-"'l} ^ XI l{r;^.Vr),"''<5-"-l-r-.l}- 

i=A"(T"'i)+l i=l 

Since the right-hand side of (A. 10) is not less than n at o""'^, so is the right- 
hand side of (A.21), which contradicts the definition of o""'^. The obtained 
contradiction proves that Q^{t) > n on [r"'"^, cr"'^). Consequently, (A. 20) 
holds for t from this interval. By (A.21), (A. 22) holds for those t, hence, 
as we have seen, (A. 13) holds. By (A. 13) and (A. 20), Q^{t) is given by 
the right-hand side of (A.ll). Thus, and A" are specified uniquely on 
[0,r"'i + (T"'i). 

For t = r'"'^ -|- fj"'^, we have that (2.2a) implies (A. 15) (with possibly 
different AA"(r"'i (t"'1)). By (2.2b) on [0, r"'i a'^'i], 

AA"(t"'1 + cj"'^) = A^"(r"'i + (j"'i) - (Q"(r"'i + ct"'1) - n)+ 

(A.23) 

+ (Q"((T"'i + a"'i)-)-n). 

In particular, AA"(r"'^ -t-o""'^) is not greater than the right-hand side of 
(A. 14), so by (A.ll) it is not greater than the right-hand side of (A. 16), and 
we obtain (A. 17) by applying (A. 9). A similar argument to the one we used 
above yields (A. 18). Then, in analogy with (A. 19) on taking into account 
(A.23), 

AQ"(t"'^ + ct"'^) < AS"(r"'i + (t"'1) - AA"(t"'1 + a"'i) 

= n V Q"(r"'i + (j"'i) - Q"((r"'i + ct"'^)-), 

so that Q'^(r'^'i + a"'i) < n V g"(T"'i + ct"'^). Hence, Q"(t"'1 + cj"'i) < n. 
By (A.23), we have (A. 14). Having established uniqueness on [0, r"'^ -|- cr"'^], 
we can use this argument repeatedly until a given t is reached. 

We have thus established existence and uniqueness for the case where 
Qq < n. If Qq > n, then we can use an analogous argument to the one 
employed when r"'^ = 0. □ 

We now provide an example of nonuniqueness in the case where there 
are zero service times. Consider a single server queue (so n = 1) with no 
customers initially. There are two arrivals: the first arrival occurs at t = 1 
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and the second at t = 2. The service times are r/i = 2 and 772 = 0, respectively. 
Thus, E'^{t) = l{f>i} + l{t>2}- The equations for Q^(t) and A^i^t) are as 
follows 

= l{j>i} + l{t>2} - l{A"(i)>l}l{l+2<i} - l{A"(i)>2}l{2+0<i}' 

A"(t) = l{,>i} + l{,>2}-(Q"(i)-l)+. 

They admit two sets of solutions: Q"'{t) = l{i<j<3}, = l{i<j<2} + 21{j>2} 
and = l{i<t<2} + 21{2<t<3}'^"'(*) = l{i<t<3} + 21{t>3}- 

APPENDIX B: CONTINUITY PROPERTIES OF CONVOLUTION 

EQUATIONS 

Let B = {B{x),x G be a distribution function on M+ with B{0) < 1. 
Given T > 0, let Loo([0,T],]R) denote the Banach space of M-valued bounded 
Borel measurable functions on [0,r] which is equipped with the uniform 
norm ||x||oo = sup4g[o,r] 1^(^)1) where x= (x{t),t G [0,r]). Consider the equa- 
tion 

(B.l) y(t)=x(t)+ [' f{y{t-s),t-s)dBis), 

Jo 

where x= (x(t),t e [0,r]) G Loo([0, T], R) and the function /:R x 1R+ 
is Borel measurable. 

Lemma B.l. If\f{y,t)\<\y\ and \f{yi,t) - f{y2,t)\ <\yi-y2\ for all y, 
yi, y2, and t from the domain, then for every x G Loo([0,T],]R) there exists 
a unique y = {y{t),t £ [0,T]) G Loo([0,T],M) which satisfies equation (B.l). 
This solution can be obtained by the method of successive approximations and 
there exists a function p{t) which only depends on the function B such that 
sup^g[OT] |y(OI — pC^) ^^Ptg[o T] 1^(01- latter bound holds more generally 
^f 

|y(i)| < |x(i)| + f\y{t-s)\dB{s). 
Jo 

If in addition, x is right- continuous with left-hand limits (respectively, ad- 
mits limits on the right and limits on the left) and f{y,t) is right- continuous 
with left-hand limits (respectively, admits limits on the right and limits on the 
left) in the second argument, then y is right- continuous with left-hand limits 
(respectively, admits limits on the right and limits on the left). If x is con- 
tinuous and either f{y,t) is continuous in the second argument, /(0,0) = 0, 
and x(0) =0, or f{y,t) admits limits on the right and limits on the left in 
the second argument, and B is continuous on [0,T] with B{0) = 0, then y 
is continuous. 
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Proof. Let to £ (0,T] be such that B{to) < 1. Define the map by 

(B.2) </)x(z)(t)=x(t)+ [' f{z{t-s),t-s)dB{s). 

Jo 

The boundedness condition on / implies that (/)x is an operator on Loo([0, to]i 
We show it is a contraction. Since |(/)x(z)(t) — (/)x(z')(t)| < \z{t — s) — z' {t — 

we have that supjg[o^to] \4>x(.^){t)-4>x{z'){t)\ < S(to) sup^gjo^^^] |z(t)- 
z'{t)\, which proves the claim because B{to) < 1. Since Loo([0,to])I^) is a Ba- 
nach space, the operator (f>^ has a unique fixed point so that the equation 
y{t) = x(t) + Jq f{y{t — s),t — s) dB{s) has a unique solution for t G [0, to]) 
which is obtained by the method of successive approximations. 

Next, on introducing ytg{t) = y{t + to), ^to{t) = x(t + to) + //"^*° /(y(t + 
to — s), t + to — s) dB{s), and ft^ {u, v) = f{u, to + f ), we can write (B.l) for 
t G [0, T — to] in the form 

(B.3) yto(t)=xt„(t)+ / ft,{yt,{t-s),t-s)dB{s). 

Jo 

The function x^o = (xt(j(t),t G [0,T — to]) is uniquely specified by x and the 
values of y(t) for t < to- The preceding argument applied to (B.3) shows 
that given y(t) for t G [0,to], there exists a unique extension of y(t) to the 
interval [to,2to A T] that satisfies the equation. The method of successive 
approximations converges to this solution. By applying this argument re- 
peatedly, we deduce existence and uniqueness of a solution in Loo([0,r],M). 
This solution is obtained by the method of successive approximations. 

If x is right-continuous with left-hand limits (respectively, admits limits 
on the right and limits on the left) and f{y,t) is right-continuous with left- 
hand limits (respectively, admits limits on the right and limits on the left) 
in t, then the successive approximations starting from the zero function 
are right-continuous with left-hand limits (respectively, admit limits on the 
right and limits on the left), so y is right-continuous with left-hand limits 
(respectively, admits limits on the right and limits on the left). A similar 
argument applies in the case where x is continuous. 

Suppose that 

|y(t)| < |x(t)| + ['\y{t-s)\dB{s) fortG[0,r]. 
Jo 

Then 

sup |y(t)| < sup |x(t)| + sup |y(t)|S(to), 

te[o,ta] te[o,to] t&[o,to] 



so 
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Next, 



Thus, 



sup |y(t)| < sup |x(t)| + sup |y(t)| 

ie[to,{2to)AT] tG[to,(2to)AT] te[o,to] 

+ sup |y(t)|(l-i?(to)). 

te[to,(2to)AT] 



sup |y(i)l < sup |x(t)| -^7—: + 



1-Bito) (l-S(to))2 



tG[0,(2to)AT] tg[0,(2to))AT] 

It follows that 

LT/toJ+l ^ 

sup |y(i)| < sup |x(t)| Yl n — r77^- 
te[o,T] t€[o,T] (1 - B[to)r □ 



The next lemma is concerned with convergence of solutions to (B.l). Let 
y" = (y"(t),t G [0,r]) GLoo([0,r],M) solve equations 

(B.4) y-(t)=x"(t)+ f r(y-{t-s),t-s)dBis), 

Jo 

where x" = (x"(t),i G [0,T]) G Loo([0,T],M) and the /" satisfy the hypothe- 
ses on / in Lemma B.l (in particular, are Lipshitz continuous in the first 
argument). 

Lemma B.2. 

1. // 

lim sup []r{y{t-s),t-s)-f{y{t-s),t-s)\dB{s) = 

and the converge to x in Loo([0, T], M), then the y" converge to y in 
Loo([0,r],M). 

2. Suppose that f"{y,t) — )■ f{y,t) as n oo for every y and t and that 
f^{y,t) is monotonically decreasing in n and monotonically increasing 
in y, that is, f"^{y,t) < f"{y,t) for m>n and < /"(y2,t) for 
yi < y2- -(f — x(t) for all t G [0,T] and sup„ sup^g^.T] < °o, 
then y" {t) y{t) for allt£[0,T]. 

Proof. In order to prove part 1, introduce 

= x-(t) - x(t) + Ar (y(t -s),t-s)- f{y{t -s),t- s)) dB{s). 
Jo 
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We have, 

|y^t) - y(t)| < li'^WI + f\nr'{t -s),t-s)- r{y{t -s),t-s)\ dB{s) 

Jo 

<|i"(t)|+ f\y^{t-s)-y{t-s)\dB{s), 
Jo 

so by Lemma B.l supjg^^r] |y"(*) - y(OI < /'(^) suPigjo.T] The hy- 

potheses imply that lim„^oo sup^g^ t] = 0. Thus, lim„^oo sup^gp r] |y"(0 - 

y{t)\=o- 

We now prove part 2. Given m G N, we define 
(B.5) x'"(i) = sup x"(t), x'^it) = inf x"(t). 

Let y"'™ and y"'™ be defined by the respective equations 

(B.6a) 5F"''"(t)=x'"(t)+ r r{y'''"'{t-s),t-s)dB{s), 

Jo 

(B.6b) y"'"^(t)=x"^(t)+ f r{r''^{t-s),t-s)dB{s). 

Jo 

Since f^{y,t) is monotonically increasing in y and is monotonically decreas- 
ing in n, an application of the method of successive approximations to (B.6a) 
and (B.6b) with the initial approximations being zero functions shows that 
the y"'™'(t) and y"''"(t) monotonically decrease in n for every t and m. Be- 
sides, the sequences {sup^gjo^T] |y"''"(*)l) ^ ^1 {^'^Pt&[o,T] ly^'^lOli^ ^ 
N} are bounded, as it follows by Lemma B.l. Thus, for t £ [0,r], there ex- 
ist finite limits y^{t) = lim„^oo y^'^C^) and y™(i) = lim„_,oo y"'"'(i). On 
letting n — >• oo in (B.6a) and (B.6b) and applying Lebesgue's bounded con- 
vergence theorem, we obtain that 

(B.7a) y™(t)=x™(t)+ f f(y^(t - s),t - s) dBis), 

Jo 

(B.7b) y™(t)=x™(t)+ f fir'it-s),t-s)dBis). 

Jo 

As m — )• oo, the x™'(f) monotonically decrease to x(t) and the x"*(0 mono- 
tonically increase to x(t). An application of the method of successive approx- 
imations to (B.7a) and (B.7b) shows that the y"^{t) monotonically decrease 
and the y"^{t) monotonically increase. The limits satisfy (B.l), so y^(t) — s- 
y{t) and y"*(t) y(i), as m — )• oo. Also, since x"^(t) < x"'(t) < x^{t) for 
n>m by "(B.5), we have by (B.l), (B.7a) and (B.7b) that y'''™(i) < y"(t) < 
y"'™(t) for n > m. It follows that y"'{t) — )• y{t) as n — )• oo. □ 
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We now study regularity properties of solutions to (B.l) for equations 
arising in Theorem 2.2. Given z = (z(t),t G [0,T]) G Loo([0,r],M), consider 
the condition 



^~^"tG[0,T] Jo 

Note that (B.8) implies the condition of part 1 of Lemma B.2 for f"'{y,t) = 
(y + nz(t))+ -nz(i)+ and /(y, i) = yl{z(t)>o} + y"^l{z(t)=o}- 

Lemma B.3. If z admits limits on the right and limits on the left and 
B{t) is continuous on [0,T] with S(0) =0, then condition (B.8) holds. 

Assume that f{y,t) = yl{z(t)>o} + y~^'^{x{t)=o} If both z and x 

are right- continuous with left-hand limits and condition (B.8) holds, then y 
is right- continuous with left-hand limits. If z is right- continuous with left- 
hand limits, X is continuous, and B(t) is continuous on [0,T] with -B(O) = 0, 
then y is continuous. 

Proof. If z admits limits on the right and limits on the left, then the 
function l{o<|z(s)|<£} has at most countably many points of discontinuity, 

which implies that the function /q l{o<|z(t-s)|<£} '^-^(s) is continuous in t 
when B{t) is a continuous function with -B(O) = 0. By Dini's theorem, the 
monotonic convergence of /q l{o<|z(t-s)|<£} dB{s) to zero as e — )■ is uniform 
in t G [0,r], as required. 

Suppose that x and z are right-continuous with left-hand limits and con- 
dition (B.8) holds. Let y" = (y"(t),t G [0,r]) solve the equation 



By Lemma B.l, the functions y"" are right-continuous with left-hand limits. 
By part 1 of Lemma B.2, the y" converge to y for the topology of compact 
convergence. Therefore, the latter function is also right-continuous with left- 
hand limits. The argument for the case where z is right-continuous with left- 
hand limits, X is continuous, and B(t) is continuous on [0,T] with i?(0) = 
is similar. □ 



This section contains results on certain processes being martingales which 
are instrumental in the proofs above. Let A = {A[t).,t G M+) be an integer- 
valued nonnegative process with nondecreasing trajectories from B(R_|_,]R). 
We denote Tj = inf{t : A{t) > i}, i G N, so the jumps of A occur at the Tj. Ob- 
viously, A{t) = Yl'iLi l{Tj<t}- Let ^i,i G N, be nonnegative random variables. 



(B.8) 





APPENDIX C: MARTINGALE LEMMAS 
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The next lemma is an extension of Lemma 5.2 in Krichagina and Puhalskii 
[15] (see also Lemma 8 in Reed [22]). 

Lemma C.l. Let A = {At,t G ]R_|_) he a filtration such that the random 
variables TjA(A(t)+i) ^^^^^ CjAA(t); where j G N, are At -measurable. Let Ai 
represent the complete a-algebras generated by the events An{Tj > t}, where 
t G M+ and At- Suppose that {f3i{x,y),x £ G G N, are real- 

valued Borel functions such that El3i{Ti,(,i)'^ < oo. The following assertions 
hold. 

1. The Ti are A-predictable stopping times. 

2. Suppose, in addition, that there exists a nondecreasing sequence of a- 
algebras Ai,i G N, such that Ai C Ai and such that the random vari- 
ables Tj, where j = 1,2, . . . ,i, and where j = 1,2, . . . ,i — 1, are Ai- 
measurable. Let, for A; G N, 

A(t)Ak 

Rk{t)= J2 

i=l 

A{t)Ak 

{Rk){t)= B{Pi{n,Cif\A^). 

i=l 

If'E{^i{Ti,^i)\Ai) = 0, then the processes Rk = {Rk{t),t G M+) and {Rk{tY - 
{Rk){t),t G M4.) are A-square-integrable martingales. 

3. The inclusions Ai C Ai hold provided the At are the complete a-algebras 
generated by the random variables Tj^^^^^),,.]^) and S,jAA{t) > where j G N, 
and the Ai are the complete a-algebras generated by the random variables 
Tj, where j = 1,2, . . . ,i, and S^j, where j = 1,2, . . . ,i — 1. 

4. If the G N, are independent, and if, for each i G N, is independent of 
the Tj for j < i, and E/3j(x, ^j) = for every x, then, for A and Ai defined 
as in part 3 and for Rk and (Rk) defined as in part 2, the processes Rk are 
A-square-integrable martingales with the predictable quadratic variation 
processes (Rk) ■ 

Proof. The rj are A-stopping times because, for t G and i G N, 
{Ti <t} = {Ti/^(^A{t)+i) ^ i} which follows on noting that T^(t)+i > t. The 
latter set belongs to At- 

The proof of the A-predictability of the Tj follows the argument of Krichag- 
ina and Puhalskii [15]. The time ri is A-predictable since the times (1 — 
1/1)ti,1 = 1,2,.-., are stopping times predicting ri (note that ti is ^q- 
measurable). For i > 1, introduce ai^i = Ti — {Ti — Ty(^i-))/l, I G N, where rj^(j) = 
maxjxp : Tp < Ti} and Tj^j-j) = if no such p exists. Obviously, ai^i f Tj as / — )• 00 
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and ai^i < ti on the set {rj > 0}. We show that the ai^i are A-stopping time. 
For t G in view of the fact that {rj <t}<Z {(Ji^i <i} <Z {T^(i) < t}, 

<t] = {n <t]u {{ui^i < t} n {T^(i) < t} n {nr,(^A{t)+i) > *})• 

The first set on the right belongs to At, as has been proved. Let f,^(,) = 

max{Tp^(^(4)+i) : rp/\(A(t)+i) < ^i^{A{t)+l)} and = nh(A(t)+i) - {'ri^{A{t)+l) - 
fj,(j))/L The random variables f^,(j) and di^i are ^t-measurable. If T,^(j) < t 
and Tj/\(^(j)+i) > t, then rj^(j) = fy(,iy On the other hand, if fi,(j) < t and 
Tif^(^A(t-^j^i-^ > t, then T,y(^i) = rj^(i). We conclude that 

{o-i,i <t}n {T^(j) < t} n {TjA{A{t)+i) > 

= {<5-i,z <t}n {f^(i) < t} n {ri;\(^(t)+i) > t}. 

The set on the right is in At- Thus, the ai^iJ £ N, are A-stopping times 
which predict r^. Part 1 has been proved. 

We prove part 2. As {A{t) >i} = {Ti/\{A(t)+i) ^ the random variables 
At are ^t-measurable, so the Rk{t) are ^f-measurable. Since supjgjg^ Ei?fe(t)^ < 
oo, to prove that Rk is an A-square-integrable martingale, it is enough to 
prove that 

A{sAa)Ak 

(C.l) E Yl /3i(-^i'^i) = 

i=l 

for any A-stopping time a (see, e.g., Jacod and Shiryaev [12], 1.1.44). We 
have 

A{sAa)Ak k 

E Yl (3^{'r^,^^)=Y^Mn<sAa}Pi{ri,^i). 
1=1 1=1 

Since {tj > s A o"} = IJ ({''"« > "u} H {n > s A a}), where the union is over all 
positive rational u, we have, by the fact that s A cr is an A-stopping time 
and hence {u> s Aa} £ Au, and the definition of Ai, that {Ti> s Aa} £ Ai. 

By the inclusion A C A, El{^^<<,^^}/3j(ri,Ci) = E(l{r,<sA<7}E(/3i(Ti,^i)|A))- 
The latter conditional expectation equals zero by hypotheses. Equality (C.l) 
has been proved. 

In order to prove that (i?fc(t)^ — {Rk){t),t € M+) is an A-square-integrable 
martingale, we show that ERk{s A a)^ = E(i?fc)(s A a) for any A-stopping 
time cr. The definition implies that 
k 

RkisAaf = Y'^{n<sAa}l3i(.Ti,^if 

i=l 

k k 

+ Y l{r,<sAa}l{rj<sA(7}ft(Ti,Ci)/3j(Tj,0)- 

1=1 j=i+l 
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Next, for i<j, in analogy with an earlier argument, using the facts that Tj 
and are ^j-measurable and that Tj is ^j-measurable, 

El{ri <sAa} 1{tj <sA<t} A ('^ i > , ) 

= E(l|,^<,^,|l{,^.<,^,}/3i(ri,e,)E(/3i(rj-,ej)l-4i)) =0. 

Therefore, 

fc 

BRkis A a)2 = E ^ l|,^<,^,}E(/3i(r„ A) = E(iZfc)(s A a). 
1=1 

Part 2 has been proved. 

By Bremaud [4], Appendix A3, Theorem 25, the flow At,t G M4-, is right- 
continuous, so we prove part 3 by showing that each generator of Ai is in Ai. 
Since {rj > t} = {A{t) + 1 < i}, we have that, if j > i, then {Tj/s,(A(t)+i) ^ 
u} n {tj > t} = {Tj/^(^(t)_|„i) < n} n {tj > t} which event is seen to be in Ai, 
and {Tj/^(^A{t)+i) < ^} n {r,, > t} € ^ when j < i. Similarly, if j > i, then 
{^jAA{t) <u}n {Ti >t} = {^(i-i)AA(t) < n {n >t} e Ai, and if j < i, then 
{CjAA(t) < n {tj > t} G a. Part 3 has been proved. 

We prove part 4. Under the hypotheses, E(/3j(rj, A) = E(/3j(x, 
^j)!^,^^, = 0. By parts 2 and 3, it remains to prove that (Rk) is A-predictable. 
As {Rk){t) = Yli=i ^{Ti<t}'EPi{x,Ci)'^\x=n, the n are A-predictable, and the 
¥jf5i{x,^i)'^\x=Ti are ^.--measurable, it follows that {Rk) is A-predictable, 
Dellacherie [5], Subsection 5 of Section 1 of Chapter 4. □ 

For k gN, introduce the two-parameter processes Lk = {Lk{t, x),t £ M+, x G 
M+) with 

(C.2) Lfc(i,x)= 2^ (^l{o<e,<x}-y^ l{«>o}i_^.(^_)J' 
where -Fj denotes the distribution function of ^j. Define also 

(C.3) {Lk){t,x)= i^^^Q^__^W_dF,(n). 

Let, for t £ and x £ M+, complete cr-algebras J-t^x be generated by 
the random variables Ti;^^^A{t)+i)j ^iAA{t)j and l^^^^gy, where i E N, s E M+, 
and s < t + X, and by l|^.<s}l|^.<,y}, where i E N, s E M+, y E M+, and 

•s + y < t + x. We denote J^t,x = r\e>o 5>0'^t+s,^+s (^^^ Figure 1) and note 
that both Lk{t,x) and {Lk){t,x) are J-j^x-measurable. (As a matter of fact, 
these random variables are J-j^o-™easurable.) In the next lemma, we define 
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Fig. 1. The G -algebra Ft.x- 



conditional probabilities as being equal to zero when the conditioning events 
are of probability zero. 

Lemma C.2. Suppose that, given i G N, s G and x € M+, the random 
variable is independent of the random variables for j ^i, of the tj for 
j < i, and of the tj A (s + x) for j > i, conditioned on the event {rj > s, > 
x}. Suppose also that each for i G N, is independent of the tj for j <i. 
Then for s <t and x <y, 

B{aLk{{s,x),{t,y))\J^s,x) = 

and 

B{{aLk{{s,x),{t,y))f\Ts,x) = a{Lk){{s,x),{t,y)). 



Proof. Assuming x and y are held fixed, we apply Lemma C.l with 
At = Tt,x and Ai being the complete cj-algebra generated by for j < i, 
by Tj for j < i, by l{Tj<s}l{T,>i} for j > i, t G M+, and s<t + x, and by 
l{Tj<4l{r,>t}l{o<?j<«} for J >i, SGIR+, t€R+, n G IR+, and s + u < t + x. 

Let us check that Ai C Ai. Pick j G N. The inclusions {Tj/,^(^A{t)+i) l^u} Ci 
{tj > t} £ Ai and {CjAA(t) ^ u}<^{Ti > t} £ Ai follow by part 3 of Lemma C.l. 
For t G M+ and s <t + x, {tj < s} D {tj > t} £ Ai by definition. Similarly, 
{Tj < s} n {0 < <u}n {n > t} G Ai, where z G N, s G M+, u G M+, and 
s + u<t + x. Thus, if A G At, then A n {r^ > t + e} G A for ah e>0, hence, 
An{ri >t} G A- 

Introduce 

JvAx ^ -c^iya ) 
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so that 

A(t)Ak 

(C.5) Lk{t,y)-Lk{t,x)= ^ Ate). 

i=l 

We show that 

(C.6) E(Ate)|A)=0. 

We have for natural numbers i < ki < k2 < • • • < kp, i < ni < n2 < • • • < rim, 
nonnegative real numbers u, i, s, ti,t2, ■ ■ ■ ,tp, si, S2, ■ ■ ■ , Sp, t[,t2, ■ ■ ■ ,tm, 
Si,S2, . . . , s'm, and ui, . . . , Um such that Sj < tj + x, s + u < t + x, and s'j+Uj < 

t'- + and for Borel bounded functions /i, . . . , gi, . . . ,gi, h^^^ , h^^ , 

(2) (2) 

h\ ,...,hm , and /, on noting that by (C.4) /3i{v) = l|t,>a;}/3j(i)) and that 
the condition s + u <i+x implies the identity l|g^>^jl|^-^^^<-|l|o<g^<ji} = 0, 

\i=i j=i j=i 

m 



n ^3 (l{rn,<s^.}l{ri>t;,}l{0<5n,<%}) 

X /(l{i<r,<S}l{0<C,<S})ftte)^ 

(i— 1 i p 

j=i j=i j=i 



m 

X I \[nf\li^^^<,y^-- - ' ^^^^ 

i=i 

(C.7) 



n(/^f' (l{.„,<s;}l{o<5.,<«.})l{r.M;} + /if (0)1|.,<,^,}) 



''i-l 



JC{l,2,...,p}, \j = l j = l JGJ 

J'C{l,2,...,m} 

ie{i,2,...,p}\j 

X JJ /if V{r„^.<s;}l{0<5n,.<«,})l{r,>i;} 
jGJ' 
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X n /if (o)i{,,<t^.}i{g,>.}/3ite) 

je{l,2,...,m}\J' / 



We show that a generic term in the sum on the rightmost side of (C.7) 

equals zero. For given J and J', let t = max j,=jtj V maxjgj/t^- and t = 

minjg|i 2,...,p}\j^i ^ ™iiijG{i,2,...,m}\j' i'j- Since sj <t + x and s'j <t + x, we 
have 

(i-l i 

i=i i=i je-f jG{i,2,..,p}\j 

jeJ' 



iG{l,2,...,m}\J 

: n n 

je{l,2,..,p}\J JG{1,2,. ..,m}\J' 



!,...,m>\J' / 



}) 



\i = l i = l JGJ 

X JJ /if (l{r„^.A(i+x)<.^.}l{0<?„.<«,}) 
JGJ' 



The independence hypotheses imply that 



E n m^)T{9Ar,) n /if (l{.,^,A(£+.)<.,}) 

\j = l j = l JGJ 

X JJ /if (l{r„.A(i+x)<s;}l{0<Cn,<%}) 

ieJ' 



l{t<rj<i}ft(Ci) 



n>t,£,i>x 



^ E n /.(^o n*-(-^-) n ^f (i^, a(£+.)<.,}) 
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^ n '^?(^{rn^A{t+x)<s'^}Mo<i^^<u,})i{i<n<t}\n >i,^i>x] 
xE(/3,(^,)|^,>x). 

By (C.4), E(^i(^i)|^i > x) = 0. We conclude that the leftmost side of (C.7) 
equals zero, which establishes (C.6). 
We now show that 

(C.8) E(ftte)Vi) = j^^^ l{">o}(Y37^^^rf^^W- 

Denoting 

— I i/„~^n\T^ —, ; 



and replicating the argument that established (C.6), we can see that (C.8) 
follows provided E(/3j(,^j)|,^j > x) = 0, which is a consequence of (C.4). 
The required properties now follow by part 2 of Lemma C.l. □ 

Let Mt denote the complete cr- algebra generated by the events {tj < 
s] n {^i < x] and {rj < s] where i G N, s S , x G M+ , and s + x <t, and let 
Mt = n£>o-^i+£ (see Figure 2). The flow M = {Mt,t(^ M+) is a filtration. 
Note that Lk{t,x) and {Lk){t,x) are A^f+^-measurable and Tt^x 3 A^t+x- 
Define, for A: e N and t G R+, 

(C.9) Mk{t)= f l{,+x<t}dLk{s,x) 

and 

(C.IO) {Mk){t)= j l|,+,<t}d(L,-)(s,x). 



Lemma C.3. Under the independence hypotheses of Lemma C.2, the 
processes Mk = {Mk{t),t G M+) are M-square integrable martingales with 
predictable quadratic variation processes {Mf.) = {{Mi.){t),t G M-i-). 

Proof. Since and {Mk) are right-continuous, it suffices to prove that 
Mk is a square integrable martingale relative to the fiow M = {Ait,t G ^+) 
with predictable quadratic variation process {Mk). 

Fix s <t. We first show that 

(C.ll) E((Lfc(0, t) - Lfc(0, s))\Ms) = 0, 

(C.12) B{{Lk{0,t) - Lk{0,s)f\Ms) = n{Lk){0,t) - {Lk){0,s)\Ms). 
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t 




t s 
Fig. 2. The a-algebra Mt- 

The argument is similar to the one used in the proof of Lemma C.2. Denote 

(C.13) C. - - J i{«>o} YTTu^' 



.2 Z^'^*-, i-Fiju) 



Let Xii denote the cj-algebra generated by the for k < j and hy Ms when 
J G N and let Ai^ =Ais- Obviously, (j is TW^-measurable. We prove that 

(C.15) E(0|>ir') = 0, 



s 



(C.16) E(C,|Air') = 0. 

We have for distinct natural numbers ki,k2, ■ ■ ■ ,kp and ni,n2, ■ ■ ■ , rim, none 
of which equals i, nonnegative real numbers s, x, 51,52, • • • ,5p, xi,X2, • • • , 
and ti, • • • ) ^m, such that s + x < s, t < s, Sj + Xj < s, and < s, and for 

Borel bounded functions /i , /2 , gi,. . . ,gk, h^^ , . . . ,hp^\ and /i^^^ , . . . , hm^ , 
E ^/i ( 1 {r, <s} 1 <i} ) /2 ( 1 {^^ <t} ) 

i— 1 p m \ 



j=i j=i j=i J 

=/i(o)E /2(i{.,<f})n*fe)n4'^(iKA.<.,}ife,<.^^ 
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fim( hil^^^^,^)llg,iC,)flhf\^^^^ 



\ j=l j=l 

m 

X n^fVK,As<t,}) 



X E(0|Ci > s)Pte > s). 

Since > s) =0 by (C.13), (C.15) follows. Equality (C.16) is obtained 

analogously. 

By (C.2) and (C.13), 1^(0, t) - Lk{0, s) = Zti Mn=o}C^■ Since {n = 0} € 
Ms, by (C.15) 

k 

E((Lfc(0,t) - Lk{0, s))\Ms) = J2 l{r,=o}E(0|A^s) = 0. 

i=l 

By (C.15), if i < i, then E(CjCi|-^.) = E(CiE(Ci|7Wr^)) = 0. We thus obtain 
on recalling (C.3), (C.14) and (C.16), 

E{{Li,{0,t)-Lk{0,s)f\Ms) 

k 

= 5^1{.,=o}E(C?|>i.) + 2j]l|.^.=o}l{r.=o}E(OOl>^«) 

i=l j<i 

= B{{Lk){0,t)-{Lk){0,s)\Ms). 

This completes the proof of (C.ll) and (C.12). 
By (C.2) and (C.9), 

(C.17) M,it) = [Mo<C.<t-n} - I l{.>0} i_;y_) J , 

which implies that Mk{t) is TW^-measurable. We prove that is a martin- 
gale. 

Let ^ = Sq < s\ < $2 < ■ ■ ■ < s\ = t be such that maxj(s' - s\_]) — ;> as 
/ — )• oo and s = for some m. Define (see Figure 3) 



(C.18a) Ji^siu,x) - ^ l{ue{s{^^,s\}}'^{x<s~sl_^} + l{«=o}l{x<4> 

i=l 

I 

(C.18b) Ji,t{u,x) = X]-'-{"e(sLi'4l}-'-{^<*-4-i} l{"=o}l{x<0' 

i=l ' ' 

(C.lSc) Mk,i{s)= Ji^s{u,x)dLk{u,x), 
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J t s 

Fig. 3. Approximating martingales. 



(C.18d) Mk,iit) = / Jm{u,x)dLk{u,x). 
Note that 

m 

(C.19a) Mkj{s) = J2 0), {s{,s - si_^)) + Lfc(0, s), 



i=l 
I 



(C.19b) Mk,i{t) = J2 0), {si,t- + Lfc(0, t). 



i=l 



Since Ji^s{u,x) — )■ 'i-{u+x<s} ^-i^d Ji,t{u,x) — )■ l{M+2;<t} as / — )• oo, it follows 
by (C.9), (C.18c) and (C.18d) that 'Mk,iis) Mk{s) and A4,;(t) ^ Mfc(t) 
as I —7- oo. By Lemma C.2 and (C.19a), 



EMfc,^^)' = J^En(Lfc)((sLi,0), {s\,s - si,)) < B{Lk){s, s) < oo. 

i=l 

Similarly, EM^^iit) < E{Lk){t,t) < oo. Hence, 
(C.20a) 
(C.20b) 



lim EiMk.iis)\Ms) = Mk{s), 

l—^oo 



lim E{MkM^s) = B{Mk{t)\Ms). 



Lemma C.2 implies that E{n\Lk{{s{_i,0),{s[,t - s{))\J'i i ) = 

i — 1 ' 1 — 1 

E(nLfc((s^_^,0),(s^,s - sJ))|J-,;_^ ,_,i_J for i = l,2,...,m and that 



E{nLkiisi_,,0),is{,t-si))\J'^ 



(ni=l,2,...,m-^s 



in (a 



i=m+l,...,l 



= for i = m + 1, . . . , L Since Aig C 
-^s' o)' by (C.ll), (C.19a) and (C.19b), 
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E,{Mk,i{t)\Ms) = B{Mkj{s)\Ms)- The martingale property of follows by 
(C.20a) and (C.20b). 

We now compute the predictable quadratic variation process. By (C.17), 
recalling (C.19b), 

Mk{t) - Mk,i{t) 

A{t)Ak I . 
(C.21) =- ^ Z]^{r,G(4_i,sm( l{5.e(i-r„t-s' ,]} 



i=\ j=l 

1 



We apply part 4 of Lemma C.l with I3i{x,y) = — '}2\=i'^Sxg(s^ s^]\ 

yA{t-s'._ ) J \ y j-i' j\t 

(^{yeit-x,t~s]_,]}- lyAit-x) ' ^{u>o}dFi{u)/{l-Fi{u-))). According to the 
lemma, 

i=l j=l Jt-n i\ J 

k I 

k 

= J2^{Fi{t - -Fi{t- n)), 

1=1 

where j(rj) is defined by the requirement that Tj G ('^' (t )-i' '^' (t )]• Since t — 
converges from the right to t — Ti as / — )• oo, — converges 
to -F(t — Tj). By bounded convergence, 

(C.22) lim E(A4(t) - Mfc,;(t))2 = 0. 

l—^oo 

Similarly, 
(C.23) 

By (C.19a) and (C.19b), 

I 

Mk,i{t) - = aLki{s{_„s - 4_, A s), (4, t - 4_,)) 

(C.24) 

+ (Lfc(0,t)-Lfc(0,s)). 



(C.23) lim E{Mk{s) - Mk,i{s)f = 0. 
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By Lemma C.2, for i < j, 

B{DLk{{sl„s - 4_, A s), (4, t - 4_,)) 

X s - 4_i A s), {s\,t- 4-i))|-^,'._^,,_,'_^aJ 

= s - sLi A s), {4,t- sLi)) 

X E(nLfe((4„i, s - A s), (4,t - 4„i))|-F, 

and 



E((nLfc((4„i, s - 4_i A s), (4,t - 4-i))) V4_,,.-4_,aJ 



□ (Lfe)((4_i, s - 4_i A s), - 4_i)), 



so, due to the fact that Mg C Fa 



(C.25) 



and 



(C.26) 



E(nLfe((4_i, s - 4_i A s), i4,t- 4_i)) 



xnLfc((4_i, s - 4_i A s), (4,t - 4-i))l-^s) = 



B{a{Lk){{sU,s - A s), {sit- sU))\Ms). 
Since Lk{0,t) and Lfc(0,s) are /"o^o-measurable, 
E(nLfe((4_i, s - 4_i A s), (4, t - 4_i))(Lfc(0, t) - Lfc(0, s)) I J-,, 
= (Lfc(0,t)-Lfc(0,s)) 

_ A (J. +- J. AWT , 

s\_i,s-s'-._^As 



xE(nLfc((4_i,s-4_iAs),(4,t-4_i))|J-,, .J=0 



so 



(C.27) 



E(nLfc((4_i, s - 4_i A s), (4,t - 4_i)) 

X (Lfc(0,t)-Lfc(0,s))|7W,)=0. 
Putting together (C.12), (C.18a), (C.18b), (C.24)-(C.27) yields 



: E □(Lfc)((4_i, . - 4_i A s), i4,t - 4_,)) 



(C.28) 



+ ((Lfe)(0,t)-(Lfc)(0,s)) 
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= e( / {Ji t{u,x) - Ji s{u,x))d{Lk){u,x) Ms 

Since Ji,siu, x) l{u+x<s} and Ji,t{u, x) l{u+x<t} as l^oo, 

lim / Jis{u,x)d{Lk){u,x)= / lsu+x<s\d{Lk){u,x), 
i-^^JrI Jul 

(C.29) 

lim / Jitiu,x)d{Lk)iu,x) = / l|„+^<rt (i(Lfc)(n, x), 

so by bounded convergence, a.s., 

limEl / {Ji^t{u,x) - Ji^s{u,x))d{Lk){u,x) 

(C.30) 

^^\Ir? ■'■{^<''+^^*>^^'^'=''*^'"'^'* •^^J' 

Putting together (C.22), (C.23), (C.28) and (C.30) and recalling the defini- 
tion of {Mk) in (C.IO) obtains the equality 

E((Mfc(t) - Mfc(s))'|7W,) =E(((Mfc)(t) - {Mk){s))\Ms) a.s. 

It remains to verify that the process (M^) is M-predictable. By (C.3), 

A: 

{Lk){t,x) = ^Li{t,x), 

i=l 

where 

f^'^^ l-Fi(u) 
(C.31) Li{t,x) = l{^^<t} l{n>o} _ j7.('^_))2 dFi{u). 

Denote 

(C.32) Mi{t)= [ l{u+x<t}dLi{u,x). 

Since (M^) = Yli=i suffices to prove that each process = {Mi{t),t € 

M+) is M-predictable. It is M-adapted which follows by the representation 

By (C.31) and (C.32), 
(C.33) M,(t) = l|,^<,} i^^^^j___^_^dF^(^). 
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Consider the decomposition Mj = M? + Mf, where Mf is a continuous- 
path adapted process and Mf is a pure-jump adapted process. By being 
continuous and adapted, M? is M-predictable. The process Mf is of the 
form 

(C.34) Mf{t) = ^ l{..+„<t}l{.<ga . \~I(^%2 ^F^i^)^ 

where the sum is taken over all positive times of jumps of Fi. Note that 
Ti is an M-stopping time by the definition of M.f Since n > in (C.34), 
Ti + u is an M-predictable stopping time. We show that 1|„<^. j is A^(^.+„)_- 
measurable. Note that {^j <u} = UteQ+ ii'^i <t}ri{Ti + u> t}). By the 
representation {n + < t} = \Js,xeQ+:s+x<ti{'^i < s} D {^i < x}), we have 
that {Ti + <t} £ Mt, hence, {^^ < u} £ M(^r,+u)~- By Dellacherie [5], 
IV. 1.5, each summand on the right of (C.34) is an M-predictable process. 
It follows that Mf is too. □ 



APPENDIX D: HOFFMANN-J0RGENSEN'S CONVERGENCE IN 

DISTRIBUTION 

In this section, we state the properties of IIoffmann-j0rgensen's conver- 
gence in distribution envoked in the proofs of Section 4. We recall the defini- 
tion stated in the introductory part of the paper. Let (O, J^, P) be a proba- 
bility space. Given a real- valued function ^ on il, the outer expectation E*,^ 
of ^ is defined as the infimum of over all random variables C on (0, J^, P) 
such that C ^ ? ci-S- and E(" exists. Let 5 be a metric space made into a 
measurable space by endowing it with the Borel c-algebra B{S). Given a 
sequence of maps from il. to S and a measurable map X from {i^,J-) to 
{S,B{S)), we say that the X„ converge to X in distribution if 

(D.l) lim E7(X„) = E/(X) 

n— >oo 

for all bounded continuous functions / on 5. We also define E*/(X„) = 
-E*(-/(X„)). 

The next result is the continuous mapping principle, which is Theorem 
1.3.6 in van der Vaart and Wellner [23]. 

Theorem D.l. Let S' be a metric space and function f : S ^ S' be 
Borel and continuous at all points of a set Sq C S. If the Xn converge in 
distribution to X in S and X assumes values in Sq, then the f{Xn) converge 
in distribution to f{X) in S' . 



Let r denote the topology on S. 
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Corollary D.l. Suppose that t' is a metric topology on S which is 
coarser than r and that open balls in {S,t) are Borel sets in (S, r'). If the 
Xn converge in distribution to X for topology t' , a subset Sq of S is such 
that convergence to the elements of Sq in t' implies convergence in r, and X 
assumes values in Sq, then the Xn converge in distribution to X for topology 

T. 

The next theorem relaxes the requirement of the separabihty of the range 
of X in the extended continuous mapping principle of van der Vaart and 
Wellner [23], cf., Theorem 1.11.1 in [23]. The proof is modelled on that of 
Lemma 3.1.13 in Puhalskii [20]. 

Theorem D.2. Let fn and f be maps from S to a metric space S' . 
Suppose that f is measurable and that the fn{xn) converge to f{x) whenever 
the Xn converge to x and x G Sq, where Sq is a Borel subset of S. If the Xn 
converge in distribution to X and X assumes values in Sq, then the fn{Xn) 
converge in distribution to f{X). 

Proof. Note that f{X) is a random element of S", so convergence in 
distribution of the f{Xn) to f{X) is well defined. Let g he a, continuous 
bounded function from S' to M. Let B^{x) denote the closed ball of radius 
5 about X G 5 and introduce 

/ifc(x) = inf sup sup5((/„(y)). 

The /ifc are bounded upper semicontinuous functions on S and hii{x) > 
g{fn{x)) for n>k, so, for arbitrary k, envoking the Portmanteau theorem 
(Theorem 1.3.4 in van der Vaart and Wellner [23]) 

limsupE*(7(/(X„)) < limsupE*/ife(X„) < Bhk{X). 

n—^oo n— >-oo 

The convergence hypotheses on the /„ and the continuity of g imply that 
the hk{x) monotonically decrease to g{f{x)) as A; — )■ oo for all x G Sq. By 
bounded convergence, limfcE/ifc(X) = 'Eg{f{X)), and we conclude that 

limsupE*<7(/(Xn))<E5(/(X)). 

n— >oo 

Applying this inequality to the function —g, we have that 
liminfE,5(/(X„))>E5(/(X)). 

n— ^oo 

Since Wg{f{Xn)) > E*c/(/(X„)), the proof is over. □ 

We now review the extensions of Prohorov's theorem. We say that the 
sequence Xn is asymptotically measurable if 

(D.2) hm (E7(X„) - E,/(X„)) = 
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for all bounded continuous functions on S. 

Define P*{A) = ^*1a for Ac ft. We say that the sequence is asymp- 
totically tight if for every e > there exists a compact set K such that 

limsupP*(X„ eS\K^)<e 

n— )-oo 

for all 6 > 0, where = {x G S : 'm(x, K) < 5}, m being the metric on S. 
The next four results are copied from van der Vaart and Wellner [23]. 

Theorem D.3. If the sequence X„ converges in distribution to a random 
element with a tight probability law, then it is asymptotically tight. 

Theorem D.4. // the sequence X„ is asymptotically tight and f : S ^ S' 
is a continuous mapping, then the sequence f{Xn) is asymptotically tight. 

Theorem D.5. If the sequence Xn is asymptotically tight and asymptot- 
ically measurable, then it has a subsequence which converges in distribution 
to a random element with a tight probability law. 

Theorem D.6. Suppose that the sequence Xn is asymptotically tight 
and (D.2) holds for all functions f from a subalgebra of the algebra of 
bounded continuous functions which separates points in S. Then the sequence 
Xn is asymptotically measurable. 

The next group of results is concerned with joint convergence. Let Yn be 
a sequence of maps from $7 to a metric space S' . The following is Lemma 
1.4.3 from van der Vaart and Wellner [23]. 

Theorem D.7. Each of the sequences Xn and Yn is asymptotically tight 
if and only if the sequence (Xn,!^) is asymptotically tight in S x S' . 

We use the following corollary of Example 1.4.6 in van der Vaart and 
Wellner [23]. 

Theorem D.8. Suppose that the Xn converge in distribution in S to a 
separable random element X and the Yn converge in distribution in S' to a 
separable random element Y. If Xn and Yn are independent for each n, then 
the {Xn.,Yn) converge in distribution in S x S' to {X,Y), where X and Y 
are independent. 

The next result is usually referred to as Slutsky's lemma; see Example 
1.4.7 in van der Vaart and Wellner [23]. 
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Theorem D.9. // the sequence Xn converges in distribution in S to a 
separable random element X and the sequence Yn converges in distribution 
in S' to a constant element cG S' , then the sequence (^7^,!^) converges in 
distribution in S x S' to {X, c) . 

The following result is in a similar vein. 

Theorem D.IO. Suppose that X^, where e > 0, converge in distribu- 
tion in S to random elements X^ as n —)• 00 and that the X^ converge in 
distribution in S to a random element X as e — )■ 0. // 

limlimsupP*(m(X„,X^) >6) = 

for arbitrary 6 > 0, then the Xn converge in distribution in S to X . 

Proof. As it follows by the Portmanteau theorem (Theorem 1.3.4 in 
van der Vaart and Wellner [23]), it suffices to prove that (D.l) holds for any 
real- valued bounded uniformly continuous function f on S. We have 

|E*/(X„) - E/(X)| < |E*/(X„) - E7(X^)| + |E*/(^n) - E/(X^)| 

+ |E/(X^)-E/(X)|. 

The hypotheses imply that 

limsuplimsup|E*/(Xn) -E/(X)| <Iimsuplimsup|E*/(X„) -E*/(^n)l- 

e— )-0 n— >oo e— >0 n— >oo 

By the triangle inequality for the outer expectation, |E*/(X„) — E*/(X^)| < 
E*|/(X„) - /(X^)|. Given arbitrary 7 > 0, let > be such that \f{x) - 
f{y)\ < 7 if m(x,y) < Then < 7 + 2sup,es l/(^)|l{m(x„,xji)>5}. 

We conclude that 

limsuplimsup|E*/(Xn) -E*/(X^)| 

e— i>0 n— >oo 

< 7 + 2 sup I /(x) I limsuplimsupP*(m(X„, X^) > 5) = 7. 
Convergence (D.l) follows. □ 

Convergence in distribution to separable random elements can be metrized. 
Let X and Y be mappings from into S. Suppose that Y is measurable. 
We define 

d*B^{X,Y)= sup \B*f{X)-Bf{Y)\, 

/GBLi 

where BLi denotes the set of real-valued functions on S that are bounded 
in absolute value by 1 and admit a Lipshitz constant of 1. The next theorem 
appears in Dudley [7]; see also van der Vaart and Wellner [23], Section 12. 
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Theorem D.ll. The sequence Xn converges in distribution in S to a 
separable random element X if and only if \\mn^ood^i^^{Xn,X) = 0. 
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